2013-10-31 16:04:37,714 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2013-10-31 16:04:37,733 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2013-10-31 16:04:37,734 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.JoinFieldedPipesPlatformTest
2013-10-31 16:04:37,760 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(118)) - using cluster
2013-10-31 16:04:38,003 INFO util.GSet (BlocksMap.java:computeCapacity(338)) - VM type = 64-bit
2013-10-31 16:04:38,003 INFO util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 16:04:38,003 INFO util.GSet (BlocksMap.java:computeCapacity(340)) - capacity = 2^21 = 2097152 entries
2013-10-31 16:04:38,004 INFO util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 16:04:38,178 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 16:04:38,178 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 16:04:38,178 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 16:04:38,181 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 16:04:38,181 WARN namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 16:04:38,181 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 16:04:38,187 INFO namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times
2013-10-31 16:04:38,322 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:38,664 INFO common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name1 has been successfully formatted.
2013-10-31 16:04:38,666 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:38,767 INFO common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name2 has been successfully formatted.
2013-10-31 16:04:38,812 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-namenode.properties, hadoop-metrics2.properties
2013-10-31 16:04:38,883 INFO util.GSet (BlocksMap.java:computeCapacity(338)) - VM type = 64-bit
2013-10-31 16:04:38,883 INFO util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 16:04:38,883 INFO util.GSet (BlocksMap.java:computeCapacity(340)) - capacity = 2^21 = 2097152 entries
2013-10-31 16:04:38,883 INFO util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 16:04:38,887 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 16:04:38,888 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 16:04:38,888 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 16:04:38,888 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 16:04:38,888 WARN namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 16:04:38,889 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 16:04:38,891 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(5306)) - Registered FSNamesystemStateMBean and NameNodeMXBean
2013-10-31 16:04:38,892 INFO namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times
2013-10-31 16:04:38,896 INFO common.Storage (FSImage.java:loadFSImage(899)) - Number of files = 1
2013-10-31 16:04:38,896 INFO common.Storage (FSImage.java:loadFilesUnderConstruction(1435)) - Number of files under construction = 0
2013-10-31 16:04:38,896 INFO common.Storage (FSImage.java:loadFSImage(832)) - Image file of size 112 loaded in 0 seconds.
2013-10-31 16:04:38,897 INFO common.Storage (FSEditLog.java:loadFSEdits(901)) - Edits file build/test/data/dfs/name1/current/edits of size 4 edits # 0 loaded in 0 seconds.
2013-10-31 16:04:38,898 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:38,943 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 16:04:39,106 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2013-10-31 16:04:39,107 INFO namenode.FSNamesystem (FSNamesystem.java:initialize(397)) - Finished loading FSImage in 220 msecs
2013-10-31 16:04:39,127 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3816)) - Total number of blocks = 0
2013-10-31 16:04:39,127 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3817)) - Number of invalid blocks = 0
2013-10-31 16:04:39,127 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3818)) - Number of under-replicated blocks = 0
2013-10-31 16:04:39,128 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3819)) - Number of over-replicated blocks = 0
2013-10-31 16:04:39,128 INFO hdfs.StateChange (FSNamesystem.java:leave(4783)) - STATE* Safe mode termination scan for invalid, over- and under-replicated blocks completed in 18 msec
2013-10-31 16:04:39,128 INFO hdfs.StateChange (FSNamesystem.java:leave(4789)) - STATE* Leaving safe mode after 0 secs.
2013-10-31 16:04:39,128 INFO hdfs.StateChange (FSNamesystem.java:leave(4798)) - STATE* Network topology has 0 racks and 0 datanodes
2013-10-31 16:04:39,129 INFO hdfs.StateChange (FSNamesystem.java:leave(4801)) - STATE* UnderReplicatedBlocks has 0 blocks
2013-10-31 16:04:39,136 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 16:04:39,137 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - ReplicateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 1 msec
2013-10-31 16:04:39,137 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - ReplicateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 1 msec processing time, 1 msec clock time, 1 cycles
2013-10-31 16:04:39,138 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - InvalidateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2013-10-31 16:04:39,138 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - InvalidateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
2013-10-31 16:04:39,148 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:39,151 INFO namenode.NameNode (NameNode.java:initialize(301)) - Namenode up at: /127.0.0.1:43856
2013-10-31 16:04:39,191 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2013-10-31 16:04:39,241 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:39,250 INFO http.HttpServer (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:39,256 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:39,257 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 37042 webServer.getConnectors()[0].getLocalPort() returned 37042
2013-10-31 16:04:39,257 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 37042
2013-10-31 16:04:39,257 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:39,293 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/hdfs to /tmp/Jetty_localhost_37042_hdfs____.8flzm4/webapp
2013-10-31 16:04:39,636 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:37042
2013-10-31 16:04:39,637 INFO namenode.NameNode (NameNode.java:run(451)) - Web-server up at: localhost:37042
2013-10-31 16:04:39,637 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:39,637 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 43856: starting
2013-10-31 16:04:39,671 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 43856: starting
2013-10-31 16:04:39,672 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 43856: starting
2013-10-31 16:04:39,672 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 43856: starting
2013-10-31 16:04:39,673 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 43856: starting
2013-10-31 16:04:39,672 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 43856: starting
2013-10-31 16:04:39,671 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 43856: starting
2013-10-31 16:04:39,673 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 43856: starting
2013-10-31 16:04:39,673 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 43856: starting
2013-10-31 16:04:39,673 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 43856: starting
2013-10-31 16:04:39,672 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 43856: starting
2013-10-31 16:04:39,834 INFO metrics.MetricsSaver (?:<init>(?)) - MetricsSaver GradleWorkerMain root:hdfs:///mnt/var/lib/hadoop/metrics/ period:60 instanceId:i-3e21d259 jobflow:j-3AAKWCJW7N40B
Starting DataNode 0 with dfs.data.dir: build/test/data/dfs/data/data1,build/test/data/dfs/data/data2
2013-10-31 16:04:39,873 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:39,874 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:39,913 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data1 is not formatted.
2013-10-31 16:04:39,914 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,209 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data2 is not formatted.
2013-10-31 16:04:41,210 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,319 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:41,333 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 38271
2013-10-31 16:04:41,337 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:41,344 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:41,348 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:41,348 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:41,348 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 57719 webServer.getConnectors()[0].getLocalPort() returned 57719
2013-10-31 16:04:41,348 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 57719
2013-10-31 16:04:41,349 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:41,355 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_57719_datanode____rvo6jo/webapp
2013-10-31 16:04:41,535 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:57719
2013-10-31 16:04:41,539 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:41,539 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:38271, storageID=, infoPort=57719, ipcPort=56394)
2013-10-31 16:04:41,551 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:38271 storage DS-799621837-10.5.128.102-38271-1383235481550
2013-10-31 16:04:41,554 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:38271
2013-10-31 16:04:41,607 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-799621837-10.5.128.102-38271-1383235481550 is assigned to data-node 127.0.0.1:38271
2013-10-31 16:04:41,607 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:41,610 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:38271 0 blocks
2013-10-31 16:04:41,612 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:04:41,613 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data1/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data2/current'}
2013-10-31 16:04:41,613 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
Starting DataNode 1 with dfs.data.dir: build/test/data/dfs/data/data3,build/test/data/dfs/data/data4
2013-10-31 16:04:41,616 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:41,616 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 56394: starting
2013-10-31 16:04:41,617 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 56394: starting
2013-10-31 16:04:41,619 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 56394: starting
2013-10-31 16:04:41,621 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:41,621 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 56394: starting
2013-10-31 16:04:41,622 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:41,623 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:41,624 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:41,631 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:38271, blocks: 0, processing time: 1 msecs
2013-10-31 16:04:41,632 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 6 msec to generate and 3 msecs for RPC and NN processing
2013-10-31 16:04:41,632 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:41,637 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 1 ms
2013-10-31 16:04:41,637 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:41,658 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data3 is not formatted.
2013-10-31 16:04:41,658 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,824 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data4 is not formatted.
2013-10-31 16:04:41,825 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:41,933 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:41,934 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:41,939 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 47311
2013-10-31 16:04:41,939 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:41,942 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:41,944 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:41,945 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:41,945 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 48798 webServer.getConnectors()[0].getLocalPort() returned 48798
2013-10-31 16:04:41,946 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 48798
2013-10-31 16:04:41,946 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:41,959 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_48798_datanode____61t8c9/webapp
2013-10-31 16:04:42,150 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:48798
2013-10-31 16:04:42,153 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:42,153 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:47311, storageID=, infoPort=48798, ipcPort=34837)
2013-10-31 16:04:42,154 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:47311 storage DS-1772526979-10.5.128.102-47311-1383235482154
2013-10-31 16:04:42,155 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:47311
2013-10-31 16:04:42,196 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1772526979-10.5.128.102-47311-1383235482154 is assigned to data-node 127.0.0.1:47311
2013-10-31 16:04:42,196 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:42,197 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:47311 0 blocks
2013-10-31 16:04:42,199 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
Starting DataNode 2 with dfs.data.dir: build/test/data/dfs/data/data5,build/test/data/dfs/data/data6
2013-10-31 16:04:42,200 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data3/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data4/current'}
2013-10-31 16:04:42,200 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 16:04:42,203 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:42,203 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 34837: starting
2013-10-31 16:04:42,204 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 34837: starting
2013-10-31 16:04:42,205 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 34837: starting
2013-10-31 16:04:42,206 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:42,208 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 34837: starting
2013-10-31 16:04:42,208 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:42,210 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:42,211 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,216 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:47311, blocks: 0, processing time: 0 msecs
2013-10-31 16:04:42,217 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 4 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 16:04:42,218 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:42,219 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 1 ms
2013-10-31 16:04:42,221 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,247 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data5 is not formatted.
2013-10-31 16:04:42,247 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:42,458 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data6 is not formatted.
2013-10-31 16:04:42,459 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:42,566 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:42,567 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:42,572 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 41648
2013-10-31 16:04:42,572 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:42,575 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:42,577 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:42,578 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:42,578 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 45464 webServer.getConnectors()[0].getLocalPort() returned 45464
2013-10-31 16:04:42,579 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 45464
2013-10-31 16:04:42,579 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:42,590 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_45464_datanode____12qsl4/webapp
2013-10-31 16:04:42,782 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:45464
2013-10-31 16:04:42,784 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:42,784 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:41648, storageID=, infoPort=45464, ipcPort=44454)
2013-10-31 16:04:42,786 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:41648 storage DS-1634612289-10.5.128.102-41648-1383235482785
2013-10-31 16:04:42,786 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:41648
2013-10-31 16:04:42,821 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1634612289-10.5.128.102-41648-1383235482785 is assigned to data-node 127.0.0.1:41648
2013-10-31 16:04:42,822 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:42,823 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:41648 0 blocks
2013-10-31 16:04:42,824 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
Starting DataNode 3 with dfs.data.dir: build/test/data/dfs/data/data7,build/test/data/dfs/data/data8
2013-10-31 16:04:42,825 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data5/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data6/current'}
2013-10-31 16:04:42,825 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 16:04:42,828 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:42,829 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 44454: starting
2013-10-31 16:04:42,830 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 44454: starting
2013-10-31 16:04:42,833 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 44454: starting
2013-10-31 16:04:42,832 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:42,831 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 44454: starting
2013-10-31 16:04:42,834 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 16:04:42,835 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:42,836 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,841 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:41648, blocks: 0, processing time: 0 msecs
2013-10-31 16:04:42,842 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 6 msec to generate and 1 msecs for RPC and NN processing
2013-10-31 16:04:42,843 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:42,844 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 1 ms
2013-10-31 16:04:42,847 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:42,867 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data7 is not formatted.
2013-10-31 16:04:42,868 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:44,429 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data8 is not formatted.
2013-10-31 16:04:44,430 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 16:04:44,550 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 16:04:44,551 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:44,556 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 50942
2013-10-31 16:04:44,556 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 16:04:44,560 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:44,562 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 16:04:44,563 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:44,563 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 32926 webServer.getConnectors()[0].getLocalPort() returned 32926
2013-10-31 16:04:44,563 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 32926
2013-10-31 16:04:44,564 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:44,572 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_32926_datanode____ad2o2t/webapp
2013-10-31 16:04:44,750 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:32926
2013-10-31 16:04:44,752 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:44,752 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:50942, storageID=, infoPort=32926, ipcPort=49535)
2013-10-31 16:04:44,754 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:50942 storage DS-1876337673-10.5.128.102-50942-1383235484753
2013-10-31 16:04:44,755 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:50942
2013-10-31 16:04:44,812 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1876337673-10.5.128.102-50942-1383235484753 is assigned to data-node 127.0.0.1:50942
2013-10-31 16:04:44,813 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 16:04:44,814 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:50942 0 blocks
2013-10-31 16:04:44,815 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:04:44,816 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data7/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/data/dfs/data/data8/current'}
2013-10-31 16:04:44,817 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 16:04:44,820 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 49535: starting
2013-10-31 16:04:44,821 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 49535: starting
2013-10-31 16:04:44,823 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 49535: starting
2013-10-31 16:04:44,822 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 16:04:44,822 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 49535: starting
2013-10-31 16:04:44,820 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:44,828 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:04:44,837 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:04:44,844 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:50942, blocks: 0, processing time: 0 msecs
2013-10-31 16:04:44,845 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 1 msec to generate and 17 msecs for RPC and NN processing
2013-10-31 16:04:44,845 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 16:04:44,847 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 16:04:44,848 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
Generating rack names for tasktrackers
Generating host names for tasktrackers
2013-10-31 16:04:44,967 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-jobtracker.properties, hadoop-metrics2.properties
2013-10-31 16:04:44,967 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=JobTracker,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:285)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:114)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:112)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:112)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 16:04:44,997 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 16:04:44,997 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(377)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-10-31 16:04:44,998 INFO mapred.JobTracker (JobTracker.java:initializeTaskMemoryRelatedConfig(5174)) - Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-10-31 16:04:44,998 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 16:04:44,998 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 16:04:45,000 INFO mapred.JobTracker (JobTracker.java:<init>(2279)) - Starting jobtracker with owner as hadoop
2013-10-31 16:04:45,003 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:45,004 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:45,014 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:45,014 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 59186 webServer.getConnectors()[0].getLocalPort() returned 59186
2013-10-31 16:04:45,014 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 59186
2013-10-31 16:04:45,014 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:45,019 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/job to /tmp/Jetty_localhost_59186_job____icd3s3/webapp
2013-10-31 16:04:45,180 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:59186
2013-10-31 16:04:45,183 INFO mapred.JobTracker (JobTracker.java:<init>(2347)) - JobTracker up at: 56620
2013-10-31 16:04:45,183 INFO mapred.JobTracker (JobTracker.java:<init>(2351)) - JobTracker webserver: 59186
2013-10-31 16:04:45,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system dst=null perm=null
2013-10-31 16:04:45,191 INFO mapred.JobTracker (JobTracker.java:<init>(2405)) - Creating the system directory
2013-10-31 16:04:45,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:04:45,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:04:45,319 INFO mapred.JobTracker (JobTracker.java:<init>(2469)) - History server being initialized in embedded mode
2013-10-31 16:04:45,323 INFO mapred.JobHistoryServer (JobHistoryServer.java:start(196)) - Started job history server at: localhost:59186
2013-10-31 16:04:45,324 INFO mapred.JobTracker (JobTracker.java:<init>(2472)) - Job History Server web address: localhost:59186
2013-10-31 16:04:45,326 INFO mapred.CompletedJobStatusStore (CompletedJobStatusStore.java:<init>(111)) - Completed job store is inactive
2013-10-31 16:04:45,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:04:45,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info dst=null perm=hadoop:supergroup:rw-------
2013-10-31 16:04:45,374 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info. blk_-8580097153134000137_1001
2013-10-31 16:04:45,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8580097153134000137_1001 src: /127.0.0.1:33458 dest: /127.0.0.1:50942
2013-10-31 16:04:45,399 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8580097153134000137_1001 src: /127.0.0.1:33528 dest: /127.0.0.1:38271
2013-10-31 16:04:45,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8580097153134000137_1001 src: /127.0.0.1:53565 dest: /127.0.0.1:41648
2013-10-31 16:04:45,406 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53565, dest: /127.0.0.1:41648, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8580097153134000137_1001, duration: 1974544
2013-10-31 16:04:45,407 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8580097153134000137_1001 terminating
2013-10-31 16:04:45,407 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8580097153134000137_1001 size 4
2013-10-31 16:04:45,408 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33528, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8580097153134000137_1001, duration: 3601721
2013-10-31 16:04:45,411 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8580097153134000137_1001 terminating
2013-10-31 16:04:45,415 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33458, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8580097153134000137_1001, duration: 9503327
2013-10-31 16:04:45,416 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8580097153134000137_1001 size 4
2013-10-31 16:04:45,416 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8580097153134000137_1001 terminating
2013-10-31 16:04:45,421 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info from client DFSClient_1457307213
2013-10-31 16:04:45,421 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/jobtracker.info is closed by DFSClient_1457307213
2013-10-31 16:04:45,422 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8580097153134000137_1001 size 4
2013-10-31 16:04:45,428 INFO mapred.JobTracker (JobTracker.java:refreshHosts(4945)) - Refreshing hosts information
2013-10-31 16:04:45,455 INFO util.HostsFileReader (HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to
2013-10-31 16:04:45,455 INFO util.HostsFileReader (HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to
2013-10-31 16:04:45,455 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 16:04:45,455 INFO mapred.JobTracker (JobTracker.java:decommissionNodes(4989)) - Decommissioning 0 nodes
2013-10-31 16:04:45,456 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 56620: starting
2013-10-31 16:04:45,456 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 56620: starting
2013-10-31 16:04:45,456 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:45,456 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 56620: starting
2013-10-31 16:04:45,458 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 56620: starting
2013-10-31 16:04:45,458 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 56620: starting
2013-10-31 16:04:45,460 INFO mapred.JobTracker (JobTracker.java:offerService(2630)) - Starting RUNNING
2013-10-31 16:04:45,460 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 56620: starting
2013-10-31 16:04:45,457 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 56620: starting
2013-10-31 16:04:45,460 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 56620: starting
2013-10-31 16:04:45,459 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 56620: starting
2013-10-31 16:04:45,459 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 56620: starting
2013-10-31 16:04:45,459 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 56620: starting
2013-10-31 16:04:45,861 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0
2013-10-31 16:04:50,889 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:50,906 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:04:50,909 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:04:50,909 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0
2013-10-31 16:04:50,922 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2013-10-31 16:04:50,927 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:50,927 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:50,928 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 51957: starting
2013-10-31 16:04:50,927 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 51957: starting
2013-10-31 16:04:50,929 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 51957: starting
2013-10-31 16:04:50,929 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 51957: starting
2013-10-31 16:04:50,929 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:51957
2013-10-31 16:04:50,930 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:04:50,929 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 51957: starting
2013-10-31 16:04:50,941 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:04:50,950 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2013-10-31 16:04:50,957 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d8e324f
2013-10-31 16:04:50,961 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:04:51,000 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:04:51,007 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:51,007 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 38122 webServer.getConnectors()[0].getLocalPort() returned 38122
2013-10-31 16:04:51,007 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 38122
2013-10-31 16:04:51,008 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:51,012 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_38122_task____ifv6iy/webapp
2013-10-31 16:04:51,167 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:38122
2013-10-31 16:04:51,167 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:04:51,168 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0
2013-10-31 16:04:51,169 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,169 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,169 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,170 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,171 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,172 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,173 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,174 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,175 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,176 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,178 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,179 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,180 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,181 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,182 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,185 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,186 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,187 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,188 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,189 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,190 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,191 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,192 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,193 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,194 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,196 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,198 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,200 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,202 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,203 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,204 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,205 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,206 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,207 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,208 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321890966
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,209 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,210 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,211 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,212 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,213 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,214 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,215 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,216 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,217 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,218 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,219 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,220 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,221 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,222 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,223 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,224 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,225 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,226 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,227 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,230 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,231 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,232 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,233 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,234 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,235 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,236 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:51,237 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321890991
2013-10-31 16:04:54,199 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/10.5.128.102
2013-10-31 16:04:54,202 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:51957 to host 10.5.128.102
2013-10-31 16:04:56,175 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:04:56,178 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:04:56,179 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:04:56,180 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0
2013-10-31 16:04:56,233 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:04:56,234 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 55789: starting
2013-10-31 16:04:56,234 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 55789: starting
2013-10-31 16:04:56,236 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 55789: starting
2013-10-31 16:04:56,235 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 55789: starting
2013-10-31 16:04:56,234 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:04:56,237 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 55789: starting
2013-10-31 16:04:56,237 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:55789
2013-10-31 16:04:56,239 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:04:56,244 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@226bd
2013-10-31 16:04:56,244 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:04:56,247 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:04:56,277 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:04:56,279 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:04:56,279 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 43403 webServer.getConnectors()[0].getLocalPort() returned 43403
2013-10-31 16:04:56,279 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 43403
2013-10-31 16:04:56,279 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:04:56,284 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_43403_task____wfge46/webapp
2013-10-31 16:04:56,435 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:43403
2013-10-31 16:04:56,435 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:04:56,436 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0
2013-10-31 16:04:56,437 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,438 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,440 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,441 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,442 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,443 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,444 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,445 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,446 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,448 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,449 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,450 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,451 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,452 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,453 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,454 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,456 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,458 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,461 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,462 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,463 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,464 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,465 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,467 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,468 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,469 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,470 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,471 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,474 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,475 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321896247
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,477 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,479 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,480 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,482 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,483 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,484 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,485 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,486 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,487 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,488 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,492 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,493 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,494 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,495 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,496 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,497 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,499 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,500 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,501 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,502 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,503 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,504 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,505 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:56,506 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321896269
2013-10-31 16:04:59,460 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:55789 to host 10.5.128.102
2013-10-31 16:05:01,440 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:05:01,443 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:05:01,444 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:05:01,445 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0
2013-10-31 16:05:01,475 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:05:01,476 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:05:01,476 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 43831: starting
2013-10-31 16:05:01,478 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 43831: starting
2013-10-31 16:05:01,476 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 43831: starting
2013-10-31 16:05:01,479 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 43831: starting
2013-10-31 16:05:01,479 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:43831
2013-10-31 16:05:01,478 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 43831: starting
2013-10-31 16:05:01,481 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:05:01,485 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4863309a
2013-10-31 16:05:01,486 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:05:01,487 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:05:01,515 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:05:01,516 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:05:01,516 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 49137 webServer.getConnectors()[0].getLocalPort() returned 49137
2013-10-31 16:05:01,517 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 49137
2013-10-31 16:05:01,517 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:05:01,521 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_49137_task____52p9e6/webapp
2013-10-31 16:05:01,671 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:49137
2013-10-31 16:05:01,672 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:05:01,673 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0
2013-10-31 16:05:01,674 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,675 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,676 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,677 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,678 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,679 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,680 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,681 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,682 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,683 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,684 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,685 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,686 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,687 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,688 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,689 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,690 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,691 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,691 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,691 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,692 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,693 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,693 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,693 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,694 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,694 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,694 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,695 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,695 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,695 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,696 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,696 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,696 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,697 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,698 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,698 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,698 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,699 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,700 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,700 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,700 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,701 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,702 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,702 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,702 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,703 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,704 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,704 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,704 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,705 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,706 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,706 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,706 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,707 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,708 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,709 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,710 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,711 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,712 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,714 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,715 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,716 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,717 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,718 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,719 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,720 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,721 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,722 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,723 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,724 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,725 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,726 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,727 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,728 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,729 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,730 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,731 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,733 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321901488
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,735 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,736 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,737 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,738 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,739 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,741 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,742 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,743 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,744 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,745 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,749 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,750 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,751 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,752 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,753 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,754 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,755 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,756 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,757 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,758 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,759 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,760 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,761 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:01,762 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321901508
2013-10-31 16:05:04,690 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:43831 to host 10.5.128.102
2013-10-31 16:05:06,682 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 16:05:06,684 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 16:05:06,686 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 16:05:06,686 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0
2013-10-31 16:05:06,714 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 16:05:06,715 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 16:05:06,716 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 34092: starting
2013-10-31 16:05:06,716 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 34092: starting
2013-10-31 16:05:06,718 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 34092: starting
2013-10-31 16:05:06,719 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 34092: starting
2013-10-31 16:05:06,719 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:34092
2013-10-31 16:05:06,720 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:05:06,719 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 34092: starting
2013-10-31 16:05:06,723 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d0f2ab8
2013-10-31 16:05:06,723 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:05:06,724 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 16:05:06,741 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 16:05:06,742 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 16:05:06,742 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 42911 webServer.getConnectors()[0].getLocalPort() returned 42911
2013-10-31 16:05:06,742 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 42911
2013-10-31 16:05:06,742 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 16:05:06,747 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_42911_task____99nbax/webapp
2013-10-31 16:05:06,936 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:42911
2013-10-31 16:05:06,936 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 16:05:06,937 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0045 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,938 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,939 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,940 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0041 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,941 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,942 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,943 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,945 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,947 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,947 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,947 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,948 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,949 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,951 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,952 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0042 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,953 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,954 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,956 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,957 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,958 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,960 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,961 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,962 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,963 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,964 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,965 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,966 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0041 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,967 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0020 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,968 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0033 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,969 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,970 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,971 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0012 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,972 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0015 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,974 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0016 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0031 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0002 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0032 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,977 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321906725
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0044 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,978 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,979 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090003226_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,980 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,981 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093122658_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,982 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0039 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,983 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,984 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,985 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,986 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0022 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0032 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,987 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0039 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0042 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,988 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0022 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031084730435_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,991 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,992 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0034 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0034 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090857785_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,995 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0036 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,996 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0043 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0039 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,997 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093556748_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0020 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,998 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0033 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0022 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:06,999 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0037 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0016 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0021 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0032 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,000 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0032 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0031 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0014 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0015 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0011 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0012 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0023 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0025 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0034 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093242096_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,002 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0040 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091103090_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0027 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,003 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031093947779_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0035 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0041 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090549820_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090106010_0001 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,004 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0009 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0007 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083105681_0010 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0017 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0042 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091954849_0006 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0013 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,005 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0019 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031091609680_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0008 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0043 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0043 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0024 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0028 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0002 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031083744295_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,006 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031080541370_0026 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031074342817_0038 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0004 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031072250800_0018 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031152505967_0005 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031154230960_0030 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031090224741_0003 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:07,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070620520_0029 for user-log deletion with retainTimeStamp:1383321906735
2013-10-31 16:05:09,952 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:34092 to host 10.5.128.102
2013-10-31 16:05:10,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,011 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt. blk_3600945390313710710_1002
2013-10-31 16:05:10,013 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3600945390313710710_1002 src: /127.0.0.1:53661 dest: /127.0.0.1:41648
2013-10-31 16:05:10,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3600945390313710710_1002 src: /127.0.0.1:33626 dest: /127.0.0.1:38271
2013-10-31 16:05:10,015 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3600945390313710710_1002 src: /127.0.0.1:46660 dest: /127.0.0.1:47311
2013-10-31 16:05:10,021 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46660, dest: /127.0.0.1:47311, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3600945390313710710_1002, duration: 4474396
2013-10-31 16:05:10,022 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3600945390313710710_1002 terminating
2013-10-31 16:05:10,023 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33626, dest: /127.0.0.1:38271, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3600945390313710710_1002, duration: 4334986
2013-10-31 16:05:10,023 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3600945390313710710_1002 terminating
2013-10-31 16:05:10,026 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53661, dest: /127.0.0.1:41648, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 5652378
2013-10-31 16:05:10,029 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3600945390313710710_1002 terminating
2013-10-31 16:05:10,031 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3600945390313710710_1002 size 15
2013-10-31 16:05:10,037 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt from client DFSClient_1457307213
2013-10-31 16:05:10,038 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt is closed by DFSClient_1457307213
2013-10-31 16:05:10,038 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3600945390313710710_1002 size 15
2013-10-31 16:05:10,039 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3600945390313710710_1002 size 15
2013-10-31 16:05:10,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,075 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt. blk_-5411765967275090315_1003
2013-10-31 16:05:10,078 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5411765967275090315_1003 src: /127.0.0.1:53664 dest: /127.0.0.1:41648
2013-10-31 16:05:10,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5411765967275090315_1003 src: /127.0.0.1:33560 dest: /127.0.0.1:50942
2013-10-31 16:05:10,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5411765967275090315_1003 src: /127.0.0.1:46663 dest: /127.0.0.1:47311
2013-10-31 16:05:10,089 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46663, dest: /127.0.0.1:47311, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 3229879
2013-10-31 16:05:10,090 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5411765967275090315_1003 terminating
2013-10-31 16:05:10,091 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5411765967275090315_1003 size 19
2013-10-31 16:05:10,093 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33560, dest: /127.0.0.1:50942, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 6443859
2013-10-31 16:05:10,093 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5411765967275090315_1003 terminating
2013-10-31 16:05:10,099 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53664, dest: /127.0.0.1:41648, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 9600271
2013-10-31 16:05:10,099 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5411765967275090315_1003 size 19
2013-10-31 16:05:10,099 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5411765967275090315_1003 terminating
2013-10-31 16:05:10,104 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5411765967275090315_1003 size 19
2013-10-31 16:05:10,105 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt from client DFSClient_1457307213
2013-10-31 16:05:10,105 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt is closed by DFSClient_1457307213
2013-10-31 16:05:10,156 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:05:10,157 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:05:10,166 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: ADA51C217F0D4666B25677A28777C299
2013-10-31 16:05:10,286 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.2.0
2013-10-31 16:05:10,290 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:05:10,291 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:05:10,291 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt"]
2013-10-31 16:05:10,292 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle"]
2013-10-31 16:05:10,292 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:05:10,292 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:05:10,293 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:05:10,294 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...splatform/joininnersingle
2013-10-31 16:05:10,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:05:10,310 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:05:10,310 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:05:10,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:10,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:05:10,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,348 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar. blk_8168766256961359884_1004
2013-10-31 16:05:10,351 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:53667 dest: /127.0.0.1:41648
2013-10-31 16:05:10,353 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:33632 dest: /127.0.0.1:38271
2013-10-31 16:05:10,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:46666 dest: /127.0.0.1:47311
2013-10-31 16:05:10,371 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46666, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8168766256961359884_1004, duration: 14241654
2013-10-31 16:05:10,372 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8168766256961359884_1004 terminating
2013-10-31 16:05:10,373 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:10,376 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33632, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8168766256961359884_1004, duration: 17358137
2013-10-31 16:05:10,376 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8168766256961359884_1004 terminating
2013-10-31 16:05:10,378 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53667, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8168766256961359884_1004, duration: 19646406
2013-10-31 16:05:10,379 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:10,379 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8168766256961359884_1004 terminating
2013-10-31 16:05:10,382 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:10,383 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar from client DFSClient_1457307213
2013-10-31 16:05:10,383 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar is closed by DFSClient_1457307213
2013-10-31 16:05:10,391 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar. New replication is 10
2013-10-31 16:05:10,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar dst=null perm=null
2013-10-31 16:05:10,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:10,403 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:05:10,426 WARN snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2013-10-31 16:05:10,431 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:05:10,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 16:05:10,857 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-5411765967275090315_1003
2013-10-31 16:05:11,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,181 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split. New replication is 10
2013-10-31 16:05:11,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=null
2013-10-31 16:05:11,195 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split. blk_6181555674910313919_1005
2013-10-31 16:05:11,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:33634 dest: /127.0.0.1:38271
2013-10-31 16:05:11,200 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:53671 dest: /127.0.0.1:41648
2013-10-31 16:05:11,202 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:33567 dest: /127.0.0.1:50942
2013-10-31 16:05:11,204 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6181555674910313919_1005 src: /127.0.0.1:46670 dest: /127.0.0.1:47311
2013-10-31 16:05:11,211 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46670, dest: /127.0.0.1:47311, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6181555674910313919_1005, duration: 4266641
2013-10-31 16:05:11,211 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,216 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33567, dest: /127.0.0.1:50942, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6181555674910313919_1005, duration: 8478316
2013-10-31 16:05:11,217 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,217 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,221 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53671, dest: /127.0.0.1:41648, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6181555674910313919_1005, duration: 11957507
2013-10-31 16:05:11,222 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,222 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33634, dest: /127.0.0.1:38271, bytes: 1767, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6181555674910313919_1005, duration: 15740488
2013-10-31 16:05:11,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,226 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6181555674910313919_1005 terminating
2013-10-31 16:05:11,229 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split from client DFSClient_1457307213
2013-10-31 16:05:11,230 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split is closed by DFSClient_1457307213
2013-10-31 16:05:11,230 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6181555674910313919_1005 size 1767
2013-10-31 16:05:11,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,257 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo. blk_-6344560666386114745_1006
2013-10-31 16:05:11,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6344560666386114745_1006 src: /127.0.0.1:53674 dest: /127.0.0.1:41648
2013-10-31 16:05:11,261 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6344560666386114745_1006 src: /127.0.0.1:46672 dest: /127.0.0.1:47311
2013-10-31 16:05:11,263 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6344560666386114745_1006 src: /127.0.0.1:33571 dest: /127.0.0.1:50942
2013-10-31 16:05:11,268 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33571, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6344560666386114745_1006, duration: 2671853
2013-10-31 16:05:11,268 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6344560666386114745_1006 terminating
2013-10-31 16:05:11,270 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46672, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6344560666386114745_1006, duration: 4918896
2013-10-31 16:05:11,271 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6344560666386114745_1006 terminating
2013-10-31 16:05:11,275 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6344560666386114745_1006 size 183
2013-10-31 16:05:11,275 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53674, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6344560666386114745_1006, duration: 7787124
2013-10-31 16:05:11,276 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6344560666386114745_1006 size 183
2013-10-31 16:05:11,276 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6344560666386114745_1006 terminating
2013-10-31 16:05:11,281 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6344560666386114745_1006 size 183
2013-10-31 16:05:11,281 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:05:11,282 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:05:11,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,433 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml. blk_-727194010295405234_1007
2013-10-31 16:05:11,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-727194010295405234_1007 src: /127.0.0.1:46674 dest: /127.0.0.1:47311
2013-10-31 16:05:11,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-727194010295405234_1007 src: /127.0.0.1:33642 dest: /127.0.0.1:38271
2013-10-31 16:05:11,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-727194010295405234_1007 src: /127.0.0.1:33574 dest: /127.0.0.1:50942
2013-10-31 16:05:11,442 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33574, dest: /127.0.0.1:50942, bytes: 28303, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-727194010295405234_1007, duration: 1349129
2013-10-31 16:05:11,442 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-727194010295405234_1007 terminating
2013-10-31 16:05:11,444 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33642, dest: /127.0.0.1:38271, bytes: 28303, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-727194010295405234_1007, duration: 2907237
2013-10-31 16:05:11,444 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-727194010295405234_1007 size 28303
2013-10-31 16:05:11,444 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-727194010295405234_1007 terminating
2013-10-31 16:05:11,446 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46674, dest: /127.0.0.1:47311, bytes: 28303, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-727194010295405234_1007, duration: 4931794
2013-10-31 16:05:11,447 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-727194010295405234_1007 terminating
2013-10-31 16:05:11,448 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-727194010295405234_1007 size 28303
2013-10-31 16:05:11,448 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml from client DFSClient_1457307213
2013-10-31 16:05:11,449 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml is closed by DFSClient_1457307213
2013-10-31 16:05:11,449 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-727194010295405234_1007 size 28303
2013-10-31 16:05:11,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml dst=null perm=null
2013-10-31 16:05:11,474 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33645, bytes: 28527, op: HDFS_READ, cliID: DFSClient_207335839, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-727194010295405234_1007, duration: 818994
2013-10-31 16:05:11,491 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0001: nMaps=5 nReduces=0 max=-1
2013-10-31 16:05:11,493 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0001 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:05:11,494 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0001 RESULT=SUCCESS
2013-10-31 16:05:11,494 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0001
2013-10-31 16:05:11,495 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0001
2013-10-31 16:05:11,497 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0001
2013-10-31 16:05:11,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:11,606 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml. blk_3172384662314539439_1009
2013-10-31 16:05:11,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3172384662314539439_1009 src: /127.0.0.1:53682 dest: /127.0.0.1:41648
2013-10-31 16:05:11,608 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3172384662314539439_1009 src: /127.0.0.1:33578 dest: /127.0.0.1:50942
2013-10-31 16:05:11,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3172384662314539439_1009 src: /127.0.0.1:33648 dest: /127.0.0.1:38271
2013-10-31 16:05:11,612 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33648, dest: /127.0.0.1:38271, bytes: 28368, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3172384662314539439_1009, duration: 2363293
2013-10-31 16:05:11,612 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3172384662314539439_1009 terminating
2013-10-31 16:05:11,613 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33578, dest: /127.0.0.1:50942, bytes: 28368, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3172384662314539439_1009, duration: 2130565
2013-10-31 16:05:11,614 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3172384662314539439_1009 terminating
2013-10-31 16:05:11,615 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53682, dest: /127.0.0.1:41648, bytes: 28368, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3172384662314539439_1009, duration: 3416665
2013-10-31 16:05:11,615 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3172384662314539439_1009 terminating
2013-10-31 16:05:11,617 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3172384662314539439_1009 size 28368
2013-10-31 16:05:11,617 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml from client DFSClient_207335839
2013-10-31 16:05:11,617 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_conf.xml is closed by DFSClient_207335839
2013-10-31 16:05:11,617 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3172384662314539439_1009 size 28368
2013-10-31 16:05:11,618 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3172384662314539439_1009 size 28368
2013-10-31 16:05:12,144 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_8168766256961359884_1004 to datanode(s) 127.0.0.1:50942
2013-10-31 16:05:12,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:12,317 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken. blk_-7983879404926687502_1010
2013-10-31 16:05:12,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7983879404926687502_1010 src: /127.0.0.1:33580 dest: /127.0.0.1:50942
2013-10-31 16:05:12,322 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7983879404926687502_1010 src: /127.0.0.1:46683 dest: /127.0.0.1:47311
2013-10-31 16:05:12,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7983879404926687502_1010 src: /127.0.0.1:33651 dest: /127.0.0.1:38271
2013-10-31 16:05:12,329 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33651, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7983879404926687502_1010, duration: 1520411
2013-10-31 16:05:12,329 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7983879404926687502_1010 terminating
2013-10-31 16:05:12,331 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46683, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7983879404926687502_1010, duration: 4120747
2013-10-31 16:05:12,332 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7983879404926687502_1010 size 116
2013-10-31 16:05:12,332 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7983879404926687502_1010 terminating
2013-10-31 16:05:12,336 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33580, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7983879404926687502_1010, duration: 7869725
2013-10-31 16:05:12,336 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7983879404926687502_1010 size 116
2013-10-31 16:05:12,338 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7983879404926687502_1010 terminating
2013-10-31 16:05:12,340 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7983879404926687502_1010 size 116
2013-10-31 16:05:12,341 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken from client DFSClient_1457307213
2013-10-31 16:05:12,341 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken is closed by DFSClient_1457307213
2013-10-31 16:05:12,347 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken
2013-10-31 16:05:12,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.splitmetainfo dst=null perm=null
2013-10-31 16:05:12,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46685, bytes: 187, op: HDFS_READ, cliID: DFSClient_207335839, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6344560666386114745_1006, duration: 495355
2013-10-31 16:05:12,366 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0001 = 15. Number of splits = 5
2013-10-31 16:05:12,366 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1
2013-10-31 16:05:12,367 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,367 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,367 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,368 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,368 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,368 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,369 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,370 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,370 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,370 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,371 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,371 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0001_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:12,371 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0001 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:05:12,373 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0001 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:05:12,847 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_8168766256961359884_1004 to 127.0.0.1:50942
2013-10-31 16:05:12,851 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8168766256961359884_1004 src: /127.0.0.1:33584 dest: /127.0.0.1:50942
2013-10-31 16:05:12,852 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_8168766256961359884_1004 to /127.0.0.1:50942
2013-10-31 16:05:12,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8168766256961359884_1004 src: /127.0.0.1:33584 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:05:12,861 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8168766256961359884_1004 size 238055
2013-10-31 16:05:12,991 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0001_m_000006_0' to tip task_20131031160444934_0001_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:05:12,998 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:05:13,003 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000006_0 which needs 1 slots
2013-10-31 16:05:13,003 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000006_0 which needs 1 slots
2013-10-31 16:05:13,016 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 127 raw values into 2 aggregated values, total 2
2013-10-31 16:05:13,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken dst=null perm=null
2013-10-31 16:05:13,029 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46687, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7983879404926687502_1010, duration: 486421
2013-10-31 16:05:13,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml dst=null perm=null
2013-10-31 16:05:13,056 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46689, bytes: 28527, op: HDFS_READ, cliID: DFSClient_907600254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-727194010295405234_1007, duration: 732530
2013-10-31 16:05:13,094 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:13,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar dst=null perm=null
2013-10-31 16:05:13,120 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53693, bytes: 239915, op: HDFS_READ, cliID: DFSClient_907600254, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8168766256961359884_1004, duration: 1857758
2013-10-31 16:05:13,259 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_1984937276
2013-10-31 16:05:13,260 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_1984937276 spawned.
2013-10-31 16:05:13,262 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000006_0/taskjvm.sh
2013-10-31 16:05:14,482 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_1984937276 given task: attempt_20131031160444934_0001_m_000006_0
2013-10-31 16:05:14,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:17,930 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000006_0 0.0% setup
2013-10-31 16:05:17,935 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000006_0 is done.
2013-10-31 16:05:17,936 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000006_0 was -1
2013-10-31 16:05:17,937 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:19,018 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000006_0' has completed task_20131031160444934_0001_m_000006 successfully.
2013-10-31 16:05:19,113 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000000_0' to tip task_20131031160444934_0001_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:05:19,116 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000000
2013-10-31 16:05:19,117 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000001_0' to tip task_20131031160444934_0001_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:05:19,117 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000001
2013-10-31 16:05:19,121 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:05:19,121 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:05:19,122 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000000_0 which needs 1 slots
2013-10-31 16:05:19,122 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000000_0 which needs 1 slots
2013-10-31 16:05:19,123 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000001_0 which needs 1 slots
2013-10-31 16:05:19,123 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0001_m_000001_0 which needs 1 slots
2013-10-31 16:05:19,163 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_-1113874899
2013-10-31 16:05:19,164 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_-1113874899 spawned.
2013-10-31 16:05:19,165 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0001/attempt_20131031160444934_0001_m_000000_0. Attempting to reuse: jvm_20131031160444934_0001_m_1984937276
2013-10-31 16:05:19,166 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000001_0/taskjvm.sh
2013-10-31 16:05:19,501 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_1984937276 given task: attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:19,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=null
2013-10-31 16:05:19,608 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33666, bytes: 1783, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6181555674910313919_1005, duration: 273764
2013-10-31 16:05:19,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 16:05:19,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:19,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:19,714 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000002_0' to tip task_20131031160444934_0001_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:19,715 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000002
2013-10-31 16:05:19,716 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000003_0' to tip task_20131031160444934_0001_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:19,716 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000003
2013-10-31 16:05:19,717 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:05:19,718 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:05:19,718 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000002_0 which needs 1 slots
2013-10-31 16:05:19,718 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000002_0 which needs 1 slots
2013-10-31 16:05:19,719 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000003_0 which needs 1 slots
2013-10-31 16:05:19,719 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0001_m_000003_0 which needs 1 slots
2013-10-31 16:05:19,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken dst=null perm=null
2013-10-31 16:05:19,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33598, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7983879404926687502_1010, duration: 207272
2013-10-31 16:05:19,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml dst=null perm=null
2013-10-31 16:05:19,737 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33600, bytes: 28527, op: HDFS_READ, cliID: DFSClient_-1256889339, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-727194010295405234_1007, duration: 279585
2013-10-31 16:05:19,760 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:19,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar dst=null perm=null
2013-10-31 16:05:19,783 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53706, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1256889339, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8168766256961359884_1004, duration: 1471615
2013-10-31 16:05:19,856 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_1565160902
2013-10-31 16:05:19,857 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_1565160902 spawned.
2013-10-31 16:05:19,858 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_206848199
2013-10-31 16:05:19,858 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_206848199 spawned.
2013-10-31 16:05:19,860 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000002_0/taskjvm.sh
2013-10-31 16:05:19,860 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000003_0/taskjvm.sh
2013-10-31 16:05:19,983 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_-1113874899 given task: attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:20,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:20,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:20,080 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53708, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 193326
2013-10-31 16:05:20,083 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53709, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 164373
2013-10-31 16:05:20,090 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000. blk_-6758752448966261479_1011
2013-10-31 16:05:20,105 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758752448966261479_1011 src: /127.0.0.1:33605 dest: /127.0.0.1:50942
2013-10-31 16:05:20,106 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758752448966261479_1011 src: /127.0.0.1:33675 dest: /127.0.0.1:38271
2013-10-31 16:05:20,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758752448966261479_1011 src: /127.0.0.1:46709 dest: /127.0.0.1:47311
2013-10-31 16:05:20,113 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46709, dest: /127.0.0.1:47311, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6758752448966261479_1011, duration: 2268895
2013-10-31 16:05:20,114 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6758752448966261479_1011 terminating
2013-10-31 16:05:20,115 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33675, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6758752448966261479_1011, duration: 3202209
2013-10-31 16:05:20,115 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6758752448966261479_1011 terminating
2013-10-31 16:05:20,116 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33605, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6758752448966261479_1011, duration: 4472205
2013-10-31 16:05:20,116 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6758752448966261479_1011 terminating
2013-10-31 16:05:20,116 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6758752448966261479_1011 size 4
2013-10-31 16:05:20,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6758752448966261479_1011 size 4
2013-10-31 16:05:20,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6758752448966261479_1011 size 4
2013-10-31 16:05:20,118 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:20,119 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:20,288 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:20,289 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000000_0 0.0%
2013-10-31 16:05:20,495 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0001_m_000004_0' to tip task_20131031160444934_0001_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:20,495 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0001_m_000004
2013-10-31 16:05:20,497 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:05:20,497 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000004_0 which needs 1 slots
2013-10-31 16:05:20,497 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000004_0 which needs 1 slots
2013-10-31 16:05:20,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001/jobToken dst=null perm=null
2013-10-31 16:05:20,504 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46711, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7983879404926687502_1010, duration: 214302
2013-10-31 16:05:20,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.xml dst=null perm=null
2013-10-31 16:05:20,513 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33611, bytes: 28527, op: HDFS_READ, cliID: DFSClient_-1237662784, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-727194010295405234_1007, duration: 290353
2013-10-31 16:05:20,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=null
2013-10-31 16:05:20,520 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33612, bytes: 1783, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6181555674910313919_1005, duration: 254770
2013-10-31 16:05:20,535 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:20,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.jar dst=null perm=null
2013-10-31 16:05:20,556 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33682, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1237662784, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8168766256961359884_1004, duration: 1431164
2013-10-31 16:05:20,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 16:05:20,560 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53719, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 172983
2013-10-31 16:05:20,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:20,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:20,627 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_331271179
2013-10-31 16:05:20,627 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_331271179 spawned.
2013-10-31 16:05:20,629 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000004_0/taskjvm.sh
2013-10-31 16:05:20,894 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_206848199 given task: attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:21,089 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_1565160902 given task: attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:21,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=null
2013-10-31 16:05:21,412 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33618, bytes: 751, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6181555674910313919_1005, duration: 271729
2013-10-31 16:05:21,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 16:05:21,451 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53724, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 185046
2013-10-31 16:05:21,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=null
2013-10-31 16:05:21,608 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53726, bytes: 1267, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6181555674910313919_1005, duration: 263717
2013-10-31 16:05:21,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 16:05:21,648 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53727, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3600945390313710710_1002, duration: 425403
2013-10-31 16:05:22,128 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000000_0
2013-10-31 16:05:22,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0 dst=null perm=null
2013-10-31 16:05:22,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:22,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:22,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:22,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:22,910 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46725, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 190214
2013-10-31 16:05:22,919 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001. blk_7519423914612894981_1013
2013-10-31 16:05:22,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7519423914612894981_1013 src: /127.0.0.1:33624 dest: /127.0.0.1:50942
2013-10-31 16:05:22,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:22,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:22,962 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7519423914612894981_1013 src: /127.0.0.1:46727 dest: /127.0.0.1:47311
2013-10-31 16:05:22,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7519423914612894981_1013 src: /127.0.0.1:33695 dest: /127.0.0.1:38271
2013-10-31 16:05:22,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33695, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7519423914612894981_1013, duration: 3023829
2013-10-31 16:05:22,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7519423914612894981_1013 terminating
2013-10-31 16:05:22,969 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46727, dest: /127.0.0.1:47311, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7519423914612894981_1013, duration: 4379037
2013-10-31 16:05:22,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:22,970 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7519423914612894981_1013 terminating
2013-10-31 16:05:22,973 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7519423914612894981_1013 size 4
2013-10-31 16:05:22,977 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33624, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7519423914612894981_1013, duration: 11594221
2013-10-31 16:05:22,977 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7519423914612894981_1013 size 4
2013-10-31 16:05:22,978 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7519423914612894981_1013 terminating
2013-10-31 16:05:22,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000000_0 dst=null perm=null
2013-10-31 16:05:22,980 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7519423914612894981_1013 size 4
2013-10-31 16:05:22,980 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:22,981 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:22,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:23,055 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:23,055 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000001_0 0.0%
2013-10-31 16:05:23,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:23,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:23,194 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33627, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 212792
2013-10-31 16:05:23,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:23,201 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:23,201 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:23,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:23,205 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33628, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 190975
2013-10-31 16:05:23,213 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:23,213 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:23,249 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:23,249 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000003_0 0.0%
2013-10-31 16:05:23,495 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:23,495 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000002_0 0.0%
2013-10-31 16:05:23,748 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_331271179 given task: attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:24,122 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0001_m_000006_0
2013-10-31 16:05:24,123 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0001_m_000006_0
2013-10-31 16:05:24,123 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000006_0 not found in cache
2013-10-31 16:05:24,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001/job.split dst=null perm=null
2013-10-31 16:05:24,285 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53736, bytes: 751, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6181555674910313919_1005, duration: 263615
2013-10-31 16:05:24,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 16:05:24,326 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46734, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3600945390313710710_1002, duration: 447813
2013-10-31 16:05:24,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:24,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:24,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:24,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:24,576 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46735, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 360776
2013-10-31 16:05:24,593 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004. blk_765941219263834356_1015
2013-10-31 16:05:24,636 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_765941219263834356_1015 src: /127.0.0.1:53739 dest: /127.0.0.1:41648
2013-10-31 16:05:24,638 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_765941219263834356_1015 src: /127.0.0.1:33635 dest: /127.0.0.1:50942
2013-10-31 16:05:24,639 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_765941219263834356_1015 src: /127.0.0.1:33705 dest: /127.0.0.1:38271
2013-10-31 16:05:24,643 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33705, dest: /127.0.0.1:38271, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_765941219263834356_1015, duration: 2667483
2013-10-31 16:05:24,643 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_765941219263834356_1015 terminating
2013-10-31 16:05:24,644 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33635, dest: /127.0.0.1:50942, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_765941219263834356_1015, duration: 3403222
2013-10-31 16:05:24,645 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_765941219263834356_1015 size 4
2013-10-31 16:05:24,646 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53739, dest: /127.0.0.1:41648, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0001_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_765941219263834356_1015, duration: 4880546
2013-10-31 16:05:24,645 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_765941219263834356_1015 terminating
2013-10-31 16:05:24,646 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_765941219263834356_1015 terminating
2013-10-31 16:05:24,646 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_765941219263834356_1015 size 4
2013-10-31 16:05:24,647 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_765941219263834356_1015 size 4
2013-10-31 16:05:24,648 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:24,648 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:24,700 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0001_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:24,701 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000004_0 0.0%
2013-10-31 16:05:25,133 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000001_0
2013-10-31 16:05:25,621 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:0+3
2013-10-31 16:05:25,630 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:0+3
2013-10-31 16:05:25,634 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000000_0 is done.
2013-10-31 16:05:25,635 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000000_0 was -1
2013-10-31 16:05:25,635 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:25,729 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000002_0
2013-10-31 16:05:25,729 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000003_0
2013-10-31 16:05:26,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0 dst=null perm=null
2013-10-31 16:05:26,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000001_0 dst=null perm=null
2013-10-31 16:05:26,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0 dst=null perm=null
2013-10-31 16:05:26,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000003_0 dst=null perm=null
2013-10-31 16:05:26,492 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:3+3
2013-10-31 16:05:26,497 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:3+3
2013-10-31 16:05:26,500 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000001_0 is done.
2013-10-31 16:05:26,500 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000001_0 was -1
2013-10-31 16:05:26,500 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:26,504 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0001_m_000004_0
2013-10-31 16:05:26,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0 dst=null perm=null
2013-10-31 16:05:26,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000002_0 dst=null perm=null
2013-10-31 16:05:26,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0 dst=null perm=null
2013-10-31 16:05:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:26,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:26,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary/_attempt_20131031160444934_0001_m_000004_0 dst=null perm=null
2013-10-31 16:05:27,192 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:12+3
2013-10-31 16:05:27,199 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000004_0 is done.
2013-10-31 16:05:27,199 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000004_0 was -1
2013-10-31 16:05:27,200 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:27,367 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000003_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:9+3
2013-10-31 16:05:27,372 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000003_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:9+3
2013-10-31 16:05:27,374 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000003_0 is done.
2013-10-31 16:05:27,374 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000003_0 was -1
2013-10-31 16:05:27,375 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:27,570 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:6+3
2013-10-31 16:05:27,574 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower-offset.txt:6+3
2013-10-31 16:05:27,576 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000002_0 is done.
2013-10-31 16:05:27,576 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000002_0 was -1
2013-10-31 16:05:27,576 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:28,153 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000000_0' has completed task_20131031160444934_0001_m_000000 successfully.
2013-10-31 16:05:28,159 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000001_0' has completed task_20131031160444934_0001_m_000001 successfully.
2013-10-31 16:05:28,736 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000002_0' has completed task_20131031160444934_0001_m_000002 successfully.
2013-10-31 16:05:29,679 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000003_0' has completed task_20131031160444934_0001_m_000003 successfully.
2013-10-31 16:05:29,683 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000004_0' has completed task_20131031160444934_0001_m_000004 successfully.
2013-10-31 16:05:29,689 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0001_m_000005_0' to tip task_20131031160444934_0001_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:29,692 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0001_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:05:29,693 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0001_m_000005_0 which needs 1 slots
2013-10-31 16:05:29,693 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0001_m_000005_0 which needs 1 slots
2013-10-31 16:05:29,734 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0001_m_-710893147
2013-10-31 16:05:29,735 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0001_m_-710893147 spawned.
2013-10-31 16:05:29,736 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0001/attempt_20131031160444934_0001_m_000005_0/taskjvm.sh
2013-10-31 16:05:30,550 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0001_m_-710893147 given task: attempt_20131031160444934_0001_m_000005_0
2013-10-31 16:05:31,076 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000005_0 0.0%
2013-10-31 16:05:31,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary dst=null perm=null
2013-10-31 16:05:31,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:31,103 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_SUCCESS from client DFSClient_attempt_20131031160444934_0001_m_000005_0
2013-10-31 16:05:31,103 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0001_m_000005_0
2013-10-31 16:05:31,111 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,111 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:31,112 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:31,112 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8168766256961359884 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,112 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,112 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,112 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:31,113 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6181555674910313919 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:31,113 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6344560666386114745 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,113 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6344560666386114745 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,113 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6344560666386114745 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:31,113 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-727194010295405234 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:31,114 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-727194010295405234 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:31,114 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-727194010295405234 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:31,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0001 dst=null perm=null
2013-10-31 16:05:33,148 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-727194010295405234_1007
2013-10-31 16:05:33,149 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-727194010295405234_1007 blk_-6344560666386114745_1006
2013-10-31 16:05:33,227 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6344560666386114745_1006 file build/test/data/dfs/data/data3/current/blk_-6344560666386114745 for deletion
2013-10-31 16:05:33,228 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-727194010295405234_1007 file build/test/data/dfs/data/data4/current/blk_-727194010295405234 for deletion
2013-10-31 16:05:33,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data4/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:33,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6344560666386114745_1006 at file build/test/data/dfs/data/data3/current/blk_-6344560666386114745
2013-10-31 16:05:33,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data3/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:33,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-727194010295405234_1007 at file build/test/data/dfs/data/data4/current/blk_-727194010295405234
2013-10-31 16:05:33,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data3/current/blk_8168766256961359884
2013-10-31 16:05:33,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data4/current/blk_6181555674910313919
2013-10-31 16:05:33,988 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0001_m_000005_0 0.0% cleanup
2013-10-31 16:05:33,991 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0001_m_000005_0 is done.
2013-10-31 16:05:33,992 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0001_m_000005_0 was -1
2013-10-31 16:05:33,992 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:35,640 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-727194010295405234_1007 file build/test/data/dfs/data/data1/current/blk_-727194010295405234 for deletion
2013-10-31 16:05:35,641 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data2/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:35,642 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data1/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:35,642 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data2/current/blk_6181555674910313919
2013-10-31 16:05:35,642 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-727194010295405234_1007 at file build/test/data/dfs/data/data1/current/blk_-727194010295405234
2013-10-31 16:05:35,643 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data1/current/blk_8168766256961359884
2013-10-31 16:05:35,704 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0001_m_000005_0' has completed task_20131031160444934_0001_m_000005 successfully.
2013-10-31 16:05:35,708 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0001 has completed successfully.
2013-10-31 16:05:35,713 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0001,submitTime=1383235511463,launchTime=1383235512371,firstMapTaskLaunchTime=1383235519113,firstJobSetupTaskLaunchTime=1383235512958,firstJobCleanupTaskLaunchTime=1383235529689,finishTime=1383235535708,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=44,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[09F4FC493B6047ECA27EE8D8CB2299E6/6D365568CB3F48BA8CF7A01FD019301D] lower*upper/(1/1) ...splatform/joininnersingle
2013-10-31 16:05:35,720 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA. blk_5704600455657799651_1016
2013-10-31 16:05:35,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5704600455657799651_1016 src: /127.0.0.1:46746 dest: /127.0.0.1:47311
2013-10-31 16:05:35,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5704600455657799651_1016 src: /127.0.0.1:33645 dest: /127.0.0.1:50942
2013-10-31 16:05:35,727 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5704600455657799651_1016 src: /127.0.0.1:33715 dest: /127.0.0.1:38271
2013-10-31 16:05:35,737 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33715, dest: /127.0.0.1:38271, bytes: 25497, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5704600455657799651_1016, duration: 6157682
2013-10-31 16:05:35,738 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5704600455657799651_1016 terminating
2013-10-31 16:05:35,739 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33645, dest: /127.0.0.1:50942, bytes: 25497, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5704600455657799651_1016, duration: 7892709
2013-10-31 16:05:35,739 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5704600455657799651_1016 size 25497
2013-10-31 16:05:35,739 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5704600455657799651_1016 terminating
2013-10-31 16:05:35,740 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46746, dest: /127.0.0.1:47311, bytes: 25497, op: HDFS_WRITE, cliID: DFSClient_207335839, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5704600455657799651_1016, duration: 9281269
2013-10-31 16:05:35,740 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5704600455657799651_1016 terminating
2013-10-31 16:05:35,746 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5704600455657799651_1016 size 25497
2013-10-31 16:05:35,746 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA from client DFSClient_207335839
2013-10-31 16:05:35,747 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_logs/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA is closed by DFSClient_207335839
2013-10-31 16:05:35,747 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5704600455657799651_1016 size 25497
2013-10-31 16:05:36,045 INFO mapred.JobHistory (JobHistory.java:maybeMakeSubdirectory(403)) - Creating DONE subfolder at file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:05:36,050 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000004_0'
2013-10-31 16:05:36,051 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0001_1383235511463_hadoop_%5B09F4FC493B6047ECA27EE8D8CB2299E6%2F6D365568CB3F48BA to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:05:36,051 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000005_0'
2013-10-31 16:05:36,054 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7983879404926687502 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:36,054 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7983879404926687502 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:36,055 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7983879404926687502 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:36,060 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0001_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:05:36,068 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/_temporary
2013-10-31 16:05:36,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0001 dst=null perm=null
2013-10-31 16:05:36,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2013-10-31 16:05:36,132 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:05:36,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2013-10-31 16:05:36,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2013-10-31 16:05:36,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2013-10-31 16:05:36,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2013-10-31 16:05:36,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2013-10-31 16:05:36,149 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-7983879404926687502_1010
2013-10-31 16:05:36,149 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-7983879404926687502_1010 blk_-727194010295405234_1007 blk_-6344560666386114745_1006
2013-10-31 16:05:36,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2013-10-31 16:05:36,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46750, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6758752448966261479_1011, duration: 439598
2013-10-31 16:05:36,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2013-10-31 16:05:36,157 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33718, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7519423914612894981_1013, duration: 439852
2013-10-31 16:05:36,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2013-10-31 16:05:36,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2013-10-31 16:05:36,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2013-10-31 16:05:36,161 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33650, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_765941219263834356_1015, duration: 405293
2013-10-31 16:05:36,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2013-10-31 16:05:36,171 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:05:36,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2013-10-31 16:05:36,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2013-10-31 16:05:36,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2013-10-31 16:05:36,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2013-10-31 16:05:36,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2013-10-31 16:05:36,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2013-10-31 16:05:36,179 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33720, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6758752448966261479_1011, duration: 408617
2013-10-31 16:05:36,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2013-10-31 16:05:36,182 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33652, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7519423914612894981_1013, duration: 403801
2013-10-31 16:05:36,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2013-10-31 16:05:36,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2013-10-31 16:05:36,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2013-10-31 16:05:36,186 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33722, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_765941219263834356_1015, duration: 402940
2013-10-31 16:05:36,186 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joininnersingle
2013-10-31 16:05:36,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2013-10-31 16:05:36,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2013-10-31 16:05:36,196 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33723, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6758752448966261479_1011, duration: 396914
2013-10-31 16:05:36,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2013-10-31 16:05:36,202 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46757, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7519423914612894981_1013, duration: 384473
2013-10-31 16:05:36,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2013-10-31 16:05:36,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2013-10-31 16:05:36,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2013-10-31 16:05:36,214 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33656, bytes: 8, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_765941219263834356_1015, duration: 411584
2013-10-31 16:05:36,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,229 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt. blk_8236244615419800290_1017
2013-10-31 16:05:36,231 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8236244615419800290_1017 src: /127.0.0.1:33726 dest: /127.0.0.1:38271
2013-10-31 16:05:36,233 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8236244615419800290_1017 src: /127.0.0.1:46760 dest: /127.0.0.1:47311
2013-10-31 16:05:36,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8236244615419800290_1017 src: /127.0.0.1:33659 dest: /127.0.0.1:50942
2013-10-31 16:05:36,239 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33659, dest: /127.0.0.1:50942, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 982323
2013-10-31 16:05:36,239 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8236244615419800290_1017 terminating
2013-10-31 16:05:36,242 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8236244615419800290_1017 size 19
2013-10-31 16:05:36,242 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46760, dest: /127.0.0.1:47311, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 4260728
2013-10-31 16:05:36,243 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8236244615419800290_1017 terminating
2013-10-31 16:05:36,243 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33726, dest: /127.0.0.1:38271, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 5495602
2013-10-31 16:05:36,244 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8236244615419800290_1017 terminating
2013-10-31 16:05:36,247 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8236244615419800290_1017 size 19
2013-10-31 16:05:36,247 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt from client DFSClient_1457307213
2013-10-31 16:05:36,248 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt is closed by DFSClient_1457307213
2013-10-31 16:05:36,248 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8236244615419800290_1017 size 19
2013-10-31 16:05:36,280 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:05:36,281 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:05:36,281 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:36,282 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0001 being deleted.
2013-10-31 16:05:36,331 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] starting
2013-10-31 16:05:36,332 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:05:36,332 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:05:36,332 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:05:36,333 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost"]
2013-10-31 16:05:36,334 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] parallel execution is enabled: true
2013-10-31 16:05:36,334 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] starting jobs: 2
2013-10-31 16:05:36,334 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper1*upper2*lower] allocating threads: 2
2013-10-31 16:05:36,335 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] starting step: (2/2)
2013-10-31 16:05:36,340 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:05:36,340 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:05:36,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:36,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:05:36,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,361 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar. blk_-2674703006665761127_1018
2013-10-31 16:05:36,363 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:33660 dest: /127.0.0.1:50942
2013-10-31 16:05:36,364 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:46763 dest: /127.0.0.1:47311
2013-10-31 16:05:36,365 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:53767 dest: /127.0.0.1:41648
2013-10-31 16:05:36,371 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53767, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2674703006665761127_1018, duration: 4610158
2013-10-31 16:05:36,371 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2674703006665761127_1018 terminating
2013-10-31 16:05:36,372 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46763, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2674703006665761127_1018, duration: 5030433
2013-10-31 16:05:36,372 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2674703006665761127_1018 terminating
2013-10-31 16:05:36,372 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33660, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2674703006665761127_1018, duration: 4993897
2013-10-31 16:05:36,372 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:36,372 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2674703006665761127_1018 terminating
2013-10-31 16:05:36,374 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:36,374 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar from client DFSClient_1457307213
2013-10-31 16:05:36,374 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar is closed by DFSClient_1457307213
2013-10-31 16:05:36,375 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:36,379 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar. New replication is 10
2013-10-31 16:05:36,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar dst=null perm=null
2013-10-31 16:05:36,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,387 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:05:36,395 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:05:36,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:36,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,412 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split. New replication is 10
2013-10-31 16:05:36,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=null
2013-10-31 16:05:36,419 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split. blk_697700709896827018_1019
2013-10-31 16:05:36,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:33663 dest: /127.0.0.1:50942
2013-10-31 16:05:36,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:33733 dest: /127.0.0.1:38271
2013-10-31 16:05:36,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:53770 dest: /127.0.0.1:41648
2013-10-31 16:05:36,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_697700709896827018_1019 src: /127.0.0.1:46768 dest: /127.0.0.1:47311
2013-10-31 16:05:36,427 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46768, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_697700709896827018_1019, duration: 1539980
2013-10-31 16:05:36,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,427 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53770, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_697700709896827018_1019, duration: 1972195
2013-10-31 16:05:36,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,427 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33733, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_697700709896827018_1019, duration: 2210902
2013-10-31 16:05:36,428 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,428 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33663, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_697700709896827018_1019, duration: 2308724
2013-10-31 16:05:36,428 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_697700709896827018_1019 terminating
2013-10-31 16:05:36,430 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,431 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split from client DFSClient_1457307213
2013-10-31 16:05:36,431 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split is closed by DFSClient_1457307213
2013-10-31 16:05:36,431 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,432 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,432 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_697700709896827018_1019 size 1732
2013-10-31 16:05:36,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,451 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo. blk_-2325358903431004453_1020
2013-10-31 16:05:36,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2325358903431004453_1020 src: /127.0.0.1:53772 dest: /127.0.0.1:41648
2013-10-31 16:05:36,455 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2325358903431004453_1020 src: /127.0.0.1:33668 dest: /127.0.0.1:50942
2013-10-31 16:05:36,456 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2325358903431004453_1020 src: /127.0.0.1:46771 dest: /127.0.0.1:47311
2013-10-31 16:05:36,460 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46771, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2325358903431004453_1020, duration: 72445
2013-10-31 16:05:36,460 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2325358903431004453_1020 terminating
2013-10-31 16:05:36,461 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33668, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2325358903431004453_1020, duration: 1018329
2013-10-31 16:05:36,461 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2325358903431004453_1020 terminating
2013-10-31 16:05:36,462 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53772, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2325358903431004453_1020, duration: 1989052
2013-10-31 16:05:36,463 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2325358903431004453_1020 terminating
2013-10-31 16:05:36,463 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2325358903431004453_1020 size 183
2013-10-31 16:05:36,464 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2325358903431004453_1020 size 183
2013-10-31 16:05:36,465 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2325358903431004453_1020 size 183
2013-10-31 16:05:36,465 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:05:36,466 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:05:36,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:36,505 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml. blk_-2999485849396669780_1021
2013-10-31 16:05:36,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2999485849396669780_1021 src: /127.0.0.1:46772 dest: /127.0.0.1:47311
2013-10-31 16:05:36,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2999485849396669780_1021 src: /127.0.0.1:33671 dest: /127.0.0.1:50942
2013-10-31 16:05:36,511 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2999485849396669780_1021 src: /127.0.0.1:53777 dest: /127.0.0.1:41648
2013-10-31 16:05:36,514 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53777, dest: /127.0.0.1:41648, bytes: 27432, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2999485849396669780_1021, duration: 489878
2013-10-31 16:05:36,514 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2999485849396669780_1021 terminating
2013-10-31 16:05:36,515 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33671, dest: /127.0.0.1:50942, bytes: 27432, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2999485849396669780_1021, duration: 1391337
2013-10-31 16:05:36,515 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2999485849396669780_1021 terminating
2013-10-31 16:05:36,516 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46772, dest: /127.0.0.1:47311, bytes: 27432, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2999485849396669780_1021, duration: 2432977
2013-10-31 16:05:36,516 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2999485849396669780_1021 terminating
2013-10-31 16:05:36,520 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2999485849396669780_1021 size 27432
2013-10-31 16:05:36,521 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml from client DFSClient_1457307213
2013-10-31 16:05:36,521 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml is closed by DFSClient_1457307213
2013-10-31 16:05:36,522 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2999485849396669780_1021 size 27432
2013-10-31 16:05:36,522 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2999485849396669780_1021 size 27432
2013-10-31 16:05:36,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml dst=null perm=null
2013-10-31 16:05:36,545 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53779, bytes: 27648, op: HDFS_READ, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2999485849396669780_1021, duration: 609031
2013-10-31 16:05:36,568 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0002: nMaps=5 nReduces=0 max=-1
2013-10-31 16:05:36,569 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0002 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:05:36,569 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0002 RESULT=SUCCESS
2013-10-31 16:05:36,570 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0002
2013-10-31 16:05:36,570 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0002
2013-10-31 16:05:36,572 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] submitted hadoop job: job_20131031160444934_0002
2013-10-31 16:05:37,174 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000000_0'
2013-10-31 16:05:37,175 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000001_0'
2013-10-31 16:05:37,175 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000006_0'
2013-10-31 16:05:37,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:37,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:37,239 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml. blk_6715209515672176699_1023
2013-10-31 16:05:37,241 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6715209515672176699_1023 src: /127.0.0.1:33675 dest: /127.0.0.1:50942
2013-10-31 16:05:37,242 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6715209515672176699_1023 src: /127.0.0.1:33745 dest: /127.0.0.1:38271
2013-10-31 16:05:37,243 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6715209515672176699_1023 src: /127.0.0.1:53782 dest: /127.0.0.1:41648
2013-10-31 16:05:37,246 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53782, dest: /127.0.0.1:41648, bytes: 27497, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6715209515672176699_1023, duration: 2250236
2013-10-31 16:05:37,247 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6715209515672176699_1023 terminating
2013-10-31 16:05:37,247 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33745, dest: /127.0.0.1:38271, bytes: 27497, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6715209515672176699_1023, duration: 2324899
2013-10-31 16:05:37,247 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6715209515672176699_1023 terminating
2013-10-31 16:05:37,248 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33675, dest: /127.0.0.1:50942, bytes: 27497, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6715209515672176699_1023, duration: 1928796
2013-10-31 16:05:37,248 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6715209515672176699_1023 terminating
2013-10-31 16:05:37,250 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6715209515672176699_1023 size 27497
2013-10-31 16:05:37,250 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6715209515672176699_1023 size 27497
2013-10-31 16:05:37,251 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6715209515672176699_1023 size 27497
2013-10-31 16:05:37,650 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml from client DFSClient_-1555598147
2013-10-31 16:05:37,651 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_conf.xml is closed by DFSClient_-1555598147
2013-10-31 16:05:37,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:37,666 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken. blk_-5382160867474461323_1024
2013-10-31 16:05:37,668 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5382160867474461323_1024 src: /127.0.0.1:33678 dest: /127.0.0.1:50942
2013-10-31 16:05:37,670 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5382160867474461323_1024 src: /127.0.0.1:53784 dest: /127.0.0.1:41648
2013-10-31 16:05:37,672 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5382160867474461323_1024 src: /127.0.0.1:33749 dest: /127.0.0.1:38271
2013-10-31 16:05:37,675 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33749, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5382160867474461323_1024, duration: 66734
2013-10-31 16:05:37,675 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5382160867474461323_1024 terminating
2013-10-31 16:05:37,676 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53784, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5382160867474461323_1024, duration: 1098407
2013-10-31 16:05:37,676 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5382160867474461323_1024 terminating
2013-10-31 16:05:37,677 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33678, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5382160867474461323_1024, duration: 2165330
2013-10-31 16:05:37,678 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5382160867474461323_1024 terminating
2013-10-31 16:05:37,678 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5382160867474461323_1024 size 116
2013-10-31 16:05:37,683 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken from client DFSClient_1457307213
2013-10-31 16:05:37,683 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken is closed by DFSClient_1457307213
2013-10-31 16:05:37,683 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5382160867474461323_1024 size 116
2013-10-31 16:05:37,684 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5382160867474461323_1024 size 116
2013-10-31 16:05:37,689 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken
2013-10-31 16:05:37,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.splitmetainfo dst=null perm=null
2013-10-31 16:05:37,696 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33681, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2325358903431004453_1020, duration: 413332
2013-10-31 16:05:37,700 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0002 = 19. Number of splits = 5
2013-10-31 16:05:37,701 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,701 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,701 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,702 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,703 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,704 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0002_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:05:37,705 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0002 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:05:37,705 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0002 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:05:38,641 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7983879404926687502_1010 file build/test/data/dfs/data/data1/current/blk_-7983879404926687502 for deletion
2013-10-31 16:05:38,642 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7983879404926687502_1010 at file build/test/data/dfs/data/data1/current/blk_-7983879404926687502
2013-10-31 16:05:38,696 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0002_m_000006_0' to tip task_20131031160444934_0002_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:38,702 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000002_0'
2013-10-31 16:05:38,702 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0001_m_000003_0'
2013-10-31 16:05:38,704 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:05:38,705 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000006_0 which needs 1 slots
2013-10-31 16:05:38,705 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000006_0 which needs 1 slots
2013-10-31 16:05:38,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken dst=null perm=null
2013-10-31 16:05:38,717 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33682, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5382160867474461323_1024, duration: 417982
2013-10-31 16:05:38,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml dst=null perm=null
2013-10-31 16:05:38,733 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33684, bytes: 27648, op: HDFS_READ, cliID: DFSClient_-453984156, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2999485849396669780_1021, duration: 590329
2013-10-31 16:05:38,768 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:38,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar dst=null perm=null
2013-10-31 16:05:38,802 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53790, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-453984156, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2674703006665761127_1018, duration: 1781215
2013-10-31 16:05:38,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7983879404926687502_1010 file build/test/data/dfs/data/data7/current/blk_-7983879404926687502 for deletion
2013-10-31 16:05:38,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6344560666386114745_1006 file build/test/data/dfs/data/data8/current/blk_-6344560666386114745 for deletion
2013-10-31 16:05:38,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-727194010295405234_1007 file build/test/data/dfs/data/data7/current/blk_-727194010295405234 for deletion
2013-10-31 16:05:38,843 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data7/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:38,844 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data8/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:38,844 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7983879404926687502_1010 at file build/test/data/dfs/data/data7/current/blk_-7983879404926687502
2013-10-31 16:05:38,844 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6344560666386114745_1006 at file build/test/data/dfs/data/data8/current/blk_-6344560666386114745
2013-10-31 16:05:38,844 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-727194010295405234_1007 at file build/test/data/dfs/data/data7/current/blk_-727194010295405234
2013-10-31 16:05:38,845 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data8/current/blk_8168766256961359884
2013-10-31 16:05:38,845 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data7/current/blk_6181555674910313919
2013-10-31 16:05:38,912 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0001_m_1565160902
2013-10-31 16:05:38,923 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10060 with signal TERM. Exit code 0
2013-10-31 16:05:38,924 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:05:38,925 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_1252934869 spawned.
2013-10-31 16:05:38,931 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000006_0/taskjvm.sh
2013-10-31 16:05:39,022 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:39,022 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:39,022 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:05:39,023 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_1565160902 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:39,150 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-2674703006665761127_1018 to datanode(s) 127.0.0.1:38271
2013-10-31 16:05:39,151 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_6181555674910313919_1005 blk_8168766256961359884_1004 blk_-6344560666386114745_1006
2013-10-31 16:05:39,151 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-7983879404926687502_1010
2013-10-31 16:05:39,228 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7983879404926687502_1010 file build/test/data/dfs/data/data3/current/blk_-7983879404926687502 for deletion
2013-10-31 16:05:39,229 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7983879404926687502_1010 at file build/test/data/dfs/data/data3/current/blk_-7983879404926687502
2013-10-31 16:05:39,838 INFO metrics.MetricsUtil (?:emrClusterStarted(?)) - instance controller state completed
2013-10-31 16:05:39,854 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-2674703006665761127_1018 to 127.0.0.1:38271
2013-10-31 16:05:39,855 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6344560666386114745_1006 file build/test/data/dfs/data/data6/current/blk_-6344560666386114745 for deletion
2013-10-31 16:05:39,856 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6181555674910313919_1005 file build/test/data/dfs/data/data5/current/blk_6181555674910313919 for deletion
2013-10-31 16:05:39,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2674703006665761127_1018 src: /127.0.0.1:33755 dest: /127.0.0.1:38271
2013-10-31 16:05:39,856 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-2674703006665761127_1018 to /127.0.0.1:38271
2013-10-31 16:05:39,856 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8168766256961359884_1004 file build/test/data/dfs/data/data6/current/blk_8168766256961359884 for deletion
2013-10-31 16:05:39,856 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:05:39,856 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6344560666386114745_1006 at file build/test/data/dfs/data/data6/current/blk_-6344560666386114745
2013-10-31 16:05:39,857 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6181555674910313919_1005 at file build/test/data/dfs/data/data5/current/blk_6181555674910313919
2013-10-31 16:05:39,857 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8168766256961359884_1004 at file build/test/data/dfs/data/data6/current/blk_8168766256961359884
2013-10-31 16:05:39,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2674703006665761127_1018 src: /127.0.0.1:33755 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:05:39,861 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2674703006665761127_1018 size 238055
2013-10-31 16:05:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,877 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,889 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,896 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,902 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:05:39,902 INFO metrics.MetricsSaver (?:flush(?)) - Discard 42 records
2013-10-31 16:05:40,450 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_1252934869 given task: attempt_20131031160444934_0002_m_000006_0
2013-10-31 16:05:40,976 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 137 Total time for transactions(ms): 7Number of transactions batched in Syncs: 9 Number of syncs: 85 SyncTimes(ms): 4245 455
2013-10-31 16:05:40,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:41,053 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:41,053 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000004_0 not found in cache
2013-10-31 16:05:41,054 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000005_0 not found in cache
2013-10-31 16:05:41,056 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0001 for user-log deletion with retainTimeStamp:1383321941056
2013-10-31 16:05:41,269 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_331271179 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:41,284 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10166 with signal TERM. Exit code 0
2013-10-31 16:05:41,469 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:41,470 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:41,470 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:05:41,470 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_331271179 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:42,069 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_-710893147 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:42,083 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10269 with signal TERM. Exit code 0
2013-10-31 16:05:42,176 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:42,176 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000001_0 not found in cache
2013-10-31 16:05:42,176 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000000_0 not found in cache
2013-10-31 16:05:42,177 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0001 for user-log deletion with retainTimeStamp:1383321942177
2013-10-31 16:05:42,247 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:42,247 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:42,247 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:05:42,247 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_-710893147 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:42,691 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_1984937276 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:42,704 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9877 with signal TERM. Exit code 0
2013-10-31 16:05:42,872 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:42,872 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:42,872 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:05:42,872 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_1984937276 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:05:43,576 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_-1113874899 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:43,588 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9945 with signal TERM. Exit code 0
2013-10-31 16:05:43,705 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0001
2013-10-31 16:05:43,705 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000003_0 not found in cache
2013-10-31 16:05:43,706 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0001_m_000002_0 not found in cache
2013-10-31 16:05:43,706 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0001 for user-log deletion with retainTimeStamp:1383321943706
2013-10-31 16:05:43,764 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:43,764 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:43,765 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:05:43,765 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_-1113874899 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:43,887 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000006_0 0.0% setup
2013-10-31 16:05:43,891 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000006_0 is done.
2013-10-31 16:05:43,891 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000006_0 was -1
2013-10-31 16:05:43,891 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:44,430 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0001_m_206848199 since job job_20131031160444934_0001 is dead
2013-10-31 16:05:44,440 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10022 with signal TERM. Exit code 0
2013-10-31 16:05:44,646 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:05:44,646 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:05:44,646 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:05:44,646 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0001_m_206848199 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:05:44,660 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3600945390313710710_1002
2013-10-31 16:05:44,712 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000006_0' has completed task_20131031160444934_0002_m_000006 successfully.
2013-10-31 16:05:44,716 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000000_0' to tip task_20131031160444934_0002_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:44,717 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000000
2013-10-31 16:05:44,718 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000001_0' to tip task_20131031160444934_0002_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:05:44,719 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000001
2013-10-31 16:05:44,722 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:05:44,723 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:05:44,723 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000000_0 which needs 1 slots
2013-10-31 16:05:44,723 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000000_0 which needs 1 slots
2013-10-31 16:05:44,723 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000001_0 which needs 1 slots
2013-10-31 16:05:44,724 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0002_m_000001_0 which needs 1 slots
2013-10-31 16:05:44,758 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_481603449
2013-10-31 16:05:44,759 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_481603449 spawned.
2013-10-31 16:05:44,760 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0002/attempt_20131031160444934_0002_m_000000_0. Attempting to reuse: jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:05:44,761 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000001_0/taskjvm.sh
2013-10-31 16:05:44,944 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_1252934869 given task: attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:45,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=null
2013-10-31 16:05:45,064 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53795, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_697700709896827018_1019, duration: 214952
2013-10-31 16:05:45,066 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000002_0' to tip task_20131031160444934_0002_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:45,066 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000002
2013-10-31 16:05:45,067 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000003_0' to tip task_20131031160444934_0002_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:05:45,067 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000003
2013-10-31 16:05:45,068 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:05:45,068 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:05:45,068 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000002_0 which needs 1 slots
2013-10-31 16:05:45,068 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000002_0 which needs 1 slots
2013-10-31 16:05:45,069 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000003_0 which needs 1 slots
2013-10-31 16:05:45,069 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0002_m_000003_0 which needs 1 slots
2013-10-31 16:05:45,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken dst=null perm=null
2013-10-31 16:05:45,074 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33760, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5382160867474461323_1024, duration: 166551
2013-10-31 16:05:45,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml dst=null perm=null
2013-10-31 16:05:45,080 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33693, bytes: 27648, op: HDFS_READ, cliID: DFSClient_-994049571, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2999485849396669780_1021, duration: 217457
2013-10-31 16:05:45,097 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:45,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:45,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar dst=null perm=null
2013-10-31 16:05:45,114 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46796, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-994049571, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2674703006665761127_1018, duration: 1180074
2013-10-31 16:05:45,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:45,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:45,177 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_88478447
2013-10-31 16:05:45,177 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_88478447 spawned.
2013-10-31 16:05:45,178 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_955433630
2013-10-31 16:05:45,178 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_955433630 spawned.
2013-10-31 16:05:45,180 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000002_0/taskjvm.sh
2013-10-31 16:05:45,180 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000003_0/taskjvm.sh
2013-10-31 16:05:45,291 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0002_m_000004_0' to tip task_20131031160444934_0002_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:05:45,291 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0002_m_000004
2013-10-31 16:05:45,292 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:05:45,293 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000004_0 which needs 1 slots
2013-10-31 16:05:45,293 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000004_0 which needs 1 slots
2013-10-31 16:05:45,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002/jobToken dst=null perm=null
2013-10-31 16:05:45,299 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53800, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5382160867474461323_1024, duration: 202450
2013-10-31 16:05:45,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.xml dst=null perm=null
2013-10-31 16:05:45,305 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46799, bytes: 27648, op: HDFS_READ, cliID: DFSClient_946962665, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2999485849396669780_1021, duration: 227598
2013-10-31 16:05:45,320 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:05:45,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.jar dst=null perm=null
2013-10-31 16:05:45,337 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46800, bytes: 239915, op: HDFS_READ, cliID: DFSClient_946962665, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2674703006665761127_1018, duration: 1166452
2013-10-31 16:05:45,386 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53804, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 157532
2013-10-31 16:05:45,391 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000. blk_-6755368884408234344_1025
2013-10-31 16:05:45,411 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6755368884408234344_1025 src: /127.0.0.1:33769 dest: /127.0.0.1:38271
2013-10-31 16:05:45,460 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6755368884408234344_1025 src: /127.0.0.1:46803 dest: /127.0.0.1:47311
2013-10-31 16:05:45,461 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6755368884408234344_1025 src: /127.0.0.1:53807 dest: /127.0.0.1:41648
2013-10-31 16:05:45,462 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_-541739399
2013-10-31 16:05:45,462 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_-541739399 spawned.
2013-10-31 16:05:45,464 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000004_0/taskjvm.sh
2013-10-31 16:05:45,468 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53807, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6755368884408234344_1025, duration: 6433285
2013-10-31 16:05:45,468 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6755368884408234344_1025 terminating
2013-10-31 16:05:45,469 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46803, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6755368884408234344_1025, duration: 6502398
2013-10-31 16:05:45,469 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6755368884408234344_1025 terminating
2013-10-31 16:05:45,469 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33769, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6755368884408234344_1025, duration: 7123061
2013-10-31 16:05:45,469 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6755368884408234344_1025 terminating
2013-10-31 16:05:45,470 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6755368884408234344_1025 size 92
2013-10-31 16:05:45,471 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6755368884408234344_1025 size 92
2013-10-31 16:05:45,472 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6755368884408234344_1025 size 92
2013-10-31 16:05:45,473 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:45,474 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:45,714 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_481603449 given task: attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:45,852 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:45,853 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000000_0 0.0%
2013-10-31 16:05:46,243 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_88478447 given task: attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:46,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=null
2013-10-31 16:05:46,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33706, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_697700709896827018_1019, duration: 235943
2013-10-31 16:05:46,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:46,388 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46809, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 153677
2013-10-31 16:05:46,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:46,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:46,596 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001. blk_-281896601574383084_1026
2013-10-31 16:05:46,616 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_955433630 given task: attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:46,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-281896601574383084_1026 src: /127.0.0.1:53815 dest: /127.0.0.1:41648
2013-10-31 16:05:46,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-281896601574383084_1026 src: /127.0.0.1:33780 dest: /127.0.0.1:38271
2013-10-31 16:05:46,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-281896601574383084_1026 src: /127.0.0.1:46814 dest: /127.0.0.1:47311
2013-10-31 16:05:46,623 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46814, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 1335395
2013-10-31 16:05:46,623 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-281896601574383084_1026 terminating
2013-10-31 16:05:46,623 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-281896601574383084_1026 size 92
2013-10-31 16:05:46,623 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33780, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-281896601574383084_1026, duration: 1645916
2013-10-31 16:05:46,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-281896601574383084_1026 terminating
2013-10-31 16:05:46,624 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53815, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-281896601574383084_1026, duration: 2143233
2013-10-31 16:05:46,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-281896601574383084_1026 terminating
2013-10-31 16:05:46,625 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:46,625 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:46,625 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-281896601574383084_1026 size 92
2013-10-31 16:05:46,627 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-281896601574383084_1026 size 92
2013-10-31 16:05:46,677 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:46,677 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000001_0 0.0%
2013-10-31 16:05:46,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=null
2013-10-31 16:05:46,748 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46816, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_697700709896827018_1019, duration: 216291
2013-10-31 16:05:46,760 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_-541739399 given task: attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:46,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:46,787 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53820, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 174499
2013-10-31 16:05:46,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:46,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:46,990 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002. blk_7989246260074545108_1027
2013-10-31 16:05:47,013 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7989246260074545108_1027 src: /127.0.0.1:33785 dest: /127.0.0.1:38271
2013-10-31 16:05:47,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7989246260074545108_1027 src: /127.0.0.1:46819 dest: /127.0.0.1:47311
2013-10-31 16:05:47,015 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7989246260074545108_1027 src: /127.0.0.1:53823 dest: /127.0.0.1:41648
2013-10-31 16:05:47,017 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53823, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7989246260074545108_1027, duration: 1403090
2013-10-31 16:05:47,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7989246260074545108_1027 terminating
2013-10-31 16:05:47,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46819, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7989246260074545108_1027, duration: 1639278
2013-10-31 16:05:47,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7989246260074545108_1027 terminating
2013-10-31 16:05:47,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33785, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 2107246
2013-10-31 16:05:47,019 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7989246260074545108_1027 terminating
2013-10-31 16:05:47,020 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7989246260074545108_1027 size 92
2013-10-31 16:05:47,020 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7989246260074545108_1027 size 92
2013-10-31 16:05:47,020 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7989246260074545108_1027 size 92
2013-10-31 16:05:47,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=null
2013-10-31 16:05:47,121 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46822, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_697700709896827018_1019, duration: 211258
2013-10-31 16:05:47,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:47,160 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33721, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 137359
2013-10-31 16:05:47,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:47,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:47,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002/job.split dst=null perm=null
2013-10-31 16:05:47,256 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33792, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_697700709896827018_1019, duration: 222996
2013-10-31 16:05:47,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:05:47,296 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33724, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 168224
2013-10-31 16:05:47,362 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003. blk_7841801315324419468_1028
2013-10-31 16:05:47,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7841801315324419468_1028 src: /127.0.0.1:53830 dest: /127.0.0.1:41648
2013-10-31 16:05:47,386 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7841801315324419468_1028 src: /127.0.0.1:33726 dest: /127.0.0.1:50942
2013-10-31 16:05:47,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7841801315324419468_1028 src: /127.0.0.1:46829 dest: /127.0.0.1:47311
2013-10-31 16:05:47,389 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46829, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7841801315324419468_1028, duration: 1331259
2013-10-31 16:05:47,389 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7841801315324419468_1028 terminating
2013-10-31 16:05:47,389 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33726, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7841801315324419468_1028, duration: 1501622
2013-10-31 16:05:47,390 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7841801315324419468_1028 terminating
2013-10-31 16:05:47,390 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53830, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 2085259
2013-10-31 16:05:47,390 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7841801315324419468_1028 terminating
2013-10-31 16:05:47,391 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7841801315324419468_1028 size 92
2013-10-31 16:05:47,393 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7841801315324419468_1028 size 92
2013-10-31 16:05:47,393 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7841801315324419468_1028 size 92
2013-10-31 16:05:47,420 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:47,421 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:47,727 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000000_0
2013-10-31 16:05:47,727 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000001_0
2013-10-31 16:05:47,792 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:47,793 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:47,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0 dst=null perm=null
2013-10-31 16:05:47,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:48,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0 dst=null perm=null
2013-10-31 16:05:48,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:48,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:48,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:48,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:48,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000001_0 dst=null perm=null
2013-10-31 16:05:48,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000000_0 dst=null perm=null
2013-10-31 16:05:48,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:48,879 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:48,879 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000002_0 0.0%
2013-10-31 16:05:48,880 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:48,880 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000003_0 0.0%
2013-10-31 16:05:49,032 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004. blk_-4456889479922960183_1029
2013-10-31 16:05:49,055 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4456889479922960183_1029 src: /127.0.0.1:53833 dest: /127.0.0.1:41648
2013-10-31 16:05:49,056 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4456889479922960183_1029 src: /127.0.0.1:33729 dest: /127.0.0.1:50942
2013-10-31 16:05:49,057 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4456889479922960183_1029 src: /127.0.0.1:46832 dest: /127.0.0.1:47311
2013-10-31 16:05:49,059 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46832, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4456889479922960183_1029, duration: 1144689
2013-10-31 16:05:49,059 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4456889479922960183_1029 terminating
2013-10-31 16:05:49,059 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33729, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4456889479922960183_1029, duration: 1520351
2013-10-31 16:05:49,060 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4456889479922960183_1029 terminating
2013-10-31 16:05:49,060 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53833, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0002_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4456889479922960183_1029, duration: 2033088
2013-10-31 16:05:49,060 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4456889479922960183_1029 terminating
2013-10-31 16:05:49,061 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4456889479922960183_1029 size 92
2013-10-31 16:05:49,061 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:49,061 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:49,062 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4456889479922960183_1029 size 92
2013-10-31 16:05:49,063 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4456889479922960183_1029 size 92
2013-10-31 16:05:49,116 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0002_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:05:49,116 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000004_0 0.0%
2013-10-31 16:05:49,268 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:05:49,270 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000001_0 is done.
2013-10-31 16:05:49,271 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000001_0 was -1
2013-10-31 16:05:49,271 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:49,663 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8580097153134000137_1001
2013-10-31 16:05:49,723 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0002_m_000006_0
2013-10-31 16:05:49,723 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0002_m_000006_0
2013-10-31 16:05:49,724 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000006_0 not found in cache
2013-10-31 16:05:50,731 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000001_0' has completed task_20131031160444934_0002_m_000001 successfully.
2013-10-31 16:05:51,071 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:05:51,075 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:05:51,076 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000000_0 is done.
2013-10-31 16:05:51,076 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000000_0 was -1
2013-10-31 16:05:51,076 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:51,076 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000002_0
2013-10-31 16:05:51,077 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000003_0
2013-10-31 16:05:51,298 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0002_m_000004_0
2013-10-31 16:05:51,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0 dst=null perm=null
2013-10-31 16:05:51,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0 dst=null perm=null
2013-10-31 16:05:51,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:51,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:51,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:51,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:51,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000002_0 dst=null perm=null
2013-10-31 16:05:51,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000003_0 dst=null perm=null
2013-10-31 16:05:52,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0 dst=null perm=null
2013-10-31 16:05:52,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:05:52,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0/part-00004 dst=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:52,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary/_attempt_20131031160444934_0002_m_000004_0 dst=null perm=null
2013-10-31 16:05:52,728 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:05:52,730 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:05:52,731 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000002_0 is done.
2013-10-31 16:05:52,732 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000002_0 was -1
2013-10-31 16:05:52,732 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:05:53,091 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:05:53,094 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:05:53,095 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000003_0 is done.
2013-10-31 16:05:53,095 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000003_0 was -1
2013-10-31 16:05:53,095 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:53,231 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:05:53,234 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:05:53,235 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000004_0 is done.
2013-10-31 16:05:53,235 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000004_0 was -1
2013-10-31 16:05:53,236 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:53,876 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000000_0' has completed task_20131031160444934_0002_m_000000 successfully.
2013-10-31 16:05:54,121 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000002_0' has completed task_20131031160444934_0002_m_000002 successfully.
2013-10-31 16:05:54,123 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000003_0' has completed task_20131031160444934_0002_m_000003 successfully.
2013-10-31 16:05:54,304 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000004_0' has completed task_20131031160444934_0002_m_000004 successfully.
2013-10-31 16:05:54,309 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0002_m_000005_0' to tip task_20131031160444934_0002_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:05:54,311 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0002_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:05:54,311 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0002_m_000005_0 which needs 1 slots
2013-10-31 16:05:54,312 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0002_m_000005_0 which needs 1 slots
2013-10-31 16:05:54,353 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0002_m_266027598
2013-10-31 16:05:54,354 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0002_m_266027598 spawned.
2013-10-31 16:05:54,356 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0002/attempt_20131031160444934_0002_m_000005_0/taskjvm.sh
2013-10-31 16:05:55,168 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0002_m_266027598 given task: attempt_20131031160444934_0002_m_000005_0
2013-10-31 16:05:55,697 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000005_0 0.0%
2013-10-31 16:05:55,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_temporary dst=null perm=null
2013-10-31 16:05:55,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:05:55,722 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_SUCCESS from client DFSClient_attempt_20131031160444934_0002_m_000005_0
2013-10-31 16:05:55,722 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0002_m_000005_0
2013-10-31 16:05:55,730 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,730 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,731 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,731 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2674703006665761127 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:55,731 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,731 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,731 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,732 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_697700709896827018 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:05:55,732 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2325358903431004453 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,732 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2325358903431004453 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,732 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2325358903431004453 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,732 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2999485849396669780 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:05:55,733 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2999485849396669780 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:05:55,733 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2999485849396669780 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:05:55,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0002 dst=null perm=null
2013-10-31 16:05:57,154 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_697700709896827018_1019 blk_-2674703006665761127_1018
2013-10-31 16:05:57,154 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_697700709896827018_1019 blk_-2999485849396669780_1021 blk_-2325358903431004453_1020 blk_-2674703006665761127_1018
2013-10-31 16:05:57,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2999485849396669780_1021 file build/test/data/dfs/data/data3/current/blk_-2999485849396669780 for deletion
2013-10-31 16:05:57,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data4/current/blk_-2674703006665761127 for deletion
2013-10-31 16:05:57,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2999485849396669780_1021 at file build/test/data/dfs/data/data3/current/blk_-2999485849396669780
2013-10-31 16:05:57,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2325358903431004453_1020 file build/test/data/dfs/data/data4/current/blk_-2325358903431004453 for deletion
2013-10-31 16:05:57,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data3/current/blk_697700709896827018 for deletion
2013-10-31 16:05:57,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data4/current/blk_-2674703006665761127
2013-10-31 16:05:57,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data3/current/blk_697700709896827018
2013-10-31 16:05:57,236 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2325358903431004453_1020 at file build/test/data/dfs/data/data4/current/blk_-2325358903431004453
2013-10-31 16:05:58,608 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0002_m_000005_0 0.0% cleanup
2013-10-31 16:05:58,609 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0002_m_000005_0 is done.
2013-10-31 16:05:58,610 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0002_m_000005_0 was -1
2013-10-31 16:05:58,610 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:05:59,648 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data2/current/blk_-2674703006665761127 for deletion
2013-10-31 16:05:59,649 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data1/current/blk_697700709896827018 for deletion
2013-10-31 16:05:59,649 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data2/current/blk_-2674703006665761127
2013-10-31 16:05:59,649 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data1/current/blk_697700709896827018
2013-10-31 16:06:00,155 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_697700709896827018_1019 blk_-2999485849396669780_1021 blk_-2325358903431004453_1020 blk_-2674703006665761127_1018
2013-10-31 16:06:00,155 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_697700709896827018_1019 blk_-2999485849396669780_1021 blk_-2325358903431004453_1020 blk_-2674703006665761127_1018
2013-10-31 16:06:00,321 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0002_m_000005_0' has completed task_20131031160444934_0002_m_000005 successfully.
2013-10-31 16:06:00,323 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0002 has completed successfully.
2013-10-31 16:06:00,323 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0002,submitTime=1383235536530,launchTime=1383235537705,firstMapTaskLaunchTime=1383235544716,firstJobSetupTaskLaunchTime=1383235538696,firstJobCleanupTaskLaunchTime=1383235554309,finishTime=1383235560323,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=43,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[4D6DBE4C00904663A16DE2E5B8D6F5BD/4DB0B02E157744A581DC8E096E64C231] upper1*upper2*lower/(2/2)
2013-10-31 16:06:00,331 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5. blk_-685171818103965493_1030
2013-10-31 16:06:00,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-685171818103965493_1030 src: /127.0.0.1:33735 dest: /127.0.0.1:50942
2013-10-31 16:06:00,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-685171818103965493_1030 src: /127.0.0.1:33805 dest: /127.0.0.1:38271
2013-10-31 16:06:00,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-685171818103965493_1030 src: /127.0.0.1:53842 dest: /127.0.0.1:41648
2013-10-31 16:06:00,346 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53842, dest: /127.0.0.1:41648, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-685171818103965493_1030, duration: 4357057
2013-10-31 16:06:00,346 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-685171818103965493_1030 terminating
2013-10-31 16:06:00,347 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33805, dest: /127.0.0.1:38271, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-685171818103965493_1030, duration: 4267498
2013-10-31 16:06:00,347 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-685171818103965493_1030 terminating
2013-10-31 16:06:00,348 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33735, dest: /127.0.0.1:50942, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1555598147, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-685171818103965493_1030, duration: 7219814
2013-10-31 16:06:00,348 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-685171818103965493_1030 size 26337
2013-10-31 16:06:00,348 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-685171818103965493_1030 terminating
2013-10-31 16:06:00,352 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-685171818103965493_1030 size 26337
2013-10-31 16:06:00,353 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-685171818103965493_1030 size 26337
2013-10-31 16:06:00,353 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5 from client DFSClient_-1555598147
2013-10-31 16:06:00,354 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/_logs/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5 is closed by DFSClient_-1555598147
2013-10-31 16:06:00,367 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0002_1383235536530_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F4DB0B02E157744A5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:00,371 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000004_0'
2013-10-31 16:06:00,371 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000005_0'
2013-10-31 16:06:00,373 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5382160867474461323 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:00,373 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5382160867474461323 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:00,373 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5382160867474461323 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:00,378 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0002_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:00,378 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] starting step: (1/2) ...rm/joinaroundjoinleftmost
2013-10-31 16:06:00,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0002 dst=null perm=null
2013-10-31 16:06:00,389 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:00,389 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:06:00,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:00,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:06:00,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,844 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar. blk_-205831684819831428_1031
2013-10-31 16:06:00,845 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:33740 dest: /127.0.0.1:50942
2013-10-31 16:06:00,846 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:53846 dest: /127.0.0.1:41648
2013-10-31 16:06:00,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:46844 dest: /127.0.0.1:47311
2013-10-31 16:06:00,857 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46844, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-205831684819831428_1031, duration: 8839858
2013-10-31 16:06:00,857 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-205831684819831428_1031 terminating
2013-10-31 16:06:00,858 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53846, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-205831684819831428_1031, duration: 8087078
2013-10-31 16:06:00,858 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-205831684819831428_1031 terminating
2013-10-31 16:06:00,858 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33740, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-205831684819831428_1031, duration: 9914028
2013-10-31 16:06:00,859 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-205831684819831428_1031 terminating
2013-10-31 16:06:00,862 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:00,862 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar from client DFSClient_1457307213
2013-10-31 16:06:00,862 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:00,862 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:00,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2999485849396669780_1021 file build/test/data/dfs/data/data6/current/blk_-2999485849396669780 for deletion
2013-10-31 16:06:00,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data5/current/blk_-2674703006665761127 for deletion
2013-10-31 16:06:00,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2325358903431004453_1020 file build/test/data/dfs/data/data5/current/blk_-2325358903431004453 for deletion
2013-10-31 16:06:00,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2999485849396669780_1021 at file build/test/data/dfs/data/data6/current/blk_-2999485849396669780
2013-10-31 16:06:00,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data5/current/blk_-2674703006665761127
2013-10-31 16:06:00,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data6/current/blk_697700709896827018 for deletion
2013-10-31 16:06:00,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2325358903431004453_1020 at file build/test/data/dfs/data/data5/current/blk_-2325358903431004453
2013-10-31 16:06:00,864 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data6/current/blk_697700709896827018
2013-10-31 16:06:00,864 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:00,869 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar. New replication is 10
2013-10-31 16:06:00,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar dst=null perm=null
2013-10-31 16:06:00,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,882 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:00,888 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:00,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:00,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,909 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split. New replication is 10
2013-10-31 16:06:00,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=null
2013-10-31 16:06:00,920 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split. blk_-7021115318436035076_1032
2013-10-31 16:06:00,962 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:33812 dest: /127.0.0.1:38271
2013-10-31 16:06:00,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:46846 dest: /127.0.0.1:47311
2013-10-31 16:06:00,964 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:33745 dest: /127.0.0.1:50942
2013-10-31 16:06:00,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021115318436035076_1032 src: /127.0.0.1:53851 dest: /127.0.0.1:41648
2013-10-31 16:06:00,966 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53851, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7021115318436035076_1032, duration: 160087
2013-10-31 16:06:00,967 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33745, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7021115318436035076_1032, duration: 1017596
2013-10-31 16:06:00,967 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46846, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7021115318436035076_1032, duration: 1398809
2013-10-31 16:06:00,969 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,972 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33812, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 6110073
2013-10-31 16:06:00,973 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,974 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7021115318436035076_1032 terminating
2013-10-31 16:06:00,975 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,975 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,975 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split from client DFSClient_1457307213
2013-10-31 16:06:00,976 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:00,977 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7021115318436035076_1032 size 1732
2013-10-31 16:06:00,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:00,991 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo. blk_-1293847835140075373_1033
2013-10-31 16:06:00,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1293847835140075373_1033 src: /127.0.0.1:33816 dest: /127.0.0.1:38271
2013-10-31 16:06:00,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1293847835140075373_1033 src: /127.0.0.1:46850 dest: /127.0.0.1:47311
2013-10-31 16:06:00,995 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1293847835140075373_1033 src: /127.0.0.1:53854 dest: /127.0.0.1:41648
2013-10-31 16:06:00,997 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53854, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1293847835140075373_1033, duration: 32783
2013-10-31 16:06:00,997 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1293847835140075373_1033 terminating
2013-10-31 16:06:00,998 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46850, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1293847835140075373_1033, duration: 500344
2013-10-31 16:06:00,998 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1293847835140075373_1033 terminating
2013-10-31 16:06:00,999 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33816, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1293847835140075373_1033, duration: 1437594
2013-10-31 16:06:01,000 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1293847835140075373_1033 terminating
2013-10-31 16:06:01,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1293847835140075373_1033 size 183
2013-10-31 16:06:01,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1293847835140075373_1033 size 183
2013-10-31 16:06:01,001 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:01,002 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:01,003 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1293847835140075373_1033 size 183
2013-10-31 16:06:01,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,028 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml. blk_1007983707836522264_1034
2013-10-31 16:06:01,030 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1007983707836522264_1034 src: /127.0.0.1:46852 dest: /127.0.0.1:47311
2013-10-31 16:06:01,031 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1007983707836522264_1034 src: /127.0.0.1:33820 dest: /127.0.0.1:38271
2013-10-31 16:06:01,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1007983707836522264_1034 src: /127.0.0.1:53857 dest: /127.0.0.1:41648
2013-10-31 16:06:01,034 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53857, dest: /127.0.0.1:41648, bytes: 29360, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1007983707836522264_1034, duration: 1282323
2013-10-31 16:06:01,034 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1007983707836522264_1034 terminating
2013-10-31 16:06:01,035 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33820, dest: /127.0.0.1:38271, bytes: 29360, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1007983707836522264_1034, duration: 1465786
2013-10-31 16:06:01,035 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1007983707836522264_1034 terminating
2013-10-31 16:06:01,035 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46852, dest: /127.0.0.1:47311, bytes: 29360, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 1611685
2013-10-31 16:06:01,036 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1007983707836522264_1034 terminating
2013-10-31 16:06:01,037 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1007983707836522264_1034 size 29360
2013-10-31 16:06:01,038 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1007983707836522264_1034 size 29360
2013-10-31 16:06:01,038 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1007983707836522264_1034 size 29360
2013-10-31 16:06:01,199 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:01,200 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0002 being deleted.
2013-10-31 16:06:01,438 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml from client DFSClient_1457307213
2013-10-31 16:06:01,438 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:01,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml dst=null perm=null
2013-10-31 16:06:01,457 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46856, bytes: 29592, op: HDFS_READ, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 524167
2013-10-31 16:06:01,473 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0003: nMaps=5 nReduces=0 max=-1
2013-10-31 16:06:01,475 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0003 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:01,475 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0003 RESULT=SUCCESS
2013-10-31 16:06:01,475 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0003
2013-10-31 16:06:01,475 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0003
2013-10-31 16:06:01,476 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper1*upper2*lower] submitted hadoop job: job_20131031160444934_0003
2013-10-31 16:06:01,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:01,980 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml. blk_2131819952922363396_1036
2013-10-31 16:06:01,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2131819952922363396_1036 src: /127.0.0.1:33755 dest: /127.0.0.1:50942
2013-10-31 16:06:01,982 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2131819952922363396_1036 src: /127.0.0.1:33825 dest: /127.0.0.1:38271
2013-10-31 16:06:01,983 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2131819952922363396_1036 src: /127.0.0.1:46859 dest: /127.0.0.1:47311
2013-10-31 16:06:01,992 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46859, dest: /127.0.0.1:47311, bytes: 29425, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2131819952922363396_1036, duration: 38043
2013-10-31 16:06:01,992 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2131819952922363396_1036 terminating
2013-10-31 16:06:01,992 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33825, dest: /127.0.0.1:38271, bytes: 29425, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2131819952922363396_1036, duration: 1332664
2013-10-31 16:06:01,993 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2131819952922363396_1036 terminating
2013-10-31 16:06:01,993 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33755, dest: /127.0.0.1:50942, bytes: 29425, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2131819952922363396_1036, duration: 1680713
2013-10-31 16:06:01,994 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2131819952922363396_1036 terminating
2013-10-31 16:06:01,996 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2131819952922363396_1036 size 29425
2013-10-31 16:06:01,996 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml from client DFSClient_954571228
2013-10-31 16:06:01,997 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_conf.xml is closed by DFSClient_954571228
2013-10-31 16:06:01,997 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2131819952922363396_1036 size 29425
2013-10-31 16:06:01,997 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2131819952922363396_1036 size 29425
2013-10-31 16:06:02,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:02,010 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken. blk_6141873193401928131_1037
2013-10-31 16:06:02,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6141873193401928131_1037 src: /127.0.0.1:33758 dest: /127.0.0.1:50942
2013-10-31 16:06:02,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6141873193401928131_1037 src: /127.0.0.1:53864 dest: /127.0.0.1:41648
2013-10-31 16:06:02,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6141873193401928131_1037 src: /127.0.0.1:46862 dest: /127.0.0.1:47311
2013-10-31 16:06:02,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46862, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6141873193401928131_1037, duration: 29976
2013-10-31 16:06:02,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6141873193401928131_1037 terminating
2013-10-31 16:06:02,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53864, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6141873193401928131_1037, duration: 400624
2013-10-31 16:06:02,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6141873193401928131_1037 terminating
2013-10-31 16:06:02,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33758, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6141873193401928131_1037, duration: 761176
2013-10-31 16:06:02,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6141873193401928131_1037 terminating
2013-10-31 16:06:02,015 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6141873193401928131_1037 size 116
2013-10-31 16:06:02,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6141873193401928131_1037 size 116
2013-10-31 16:06:02,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6141873193401928131_1037 size 116
2013-10-31 16:06:02,416 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken from client DFSClient_1457307213
2013-10-31 16:06:02,417 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:02,422 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken
2013-10-31 16:06:02,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.splitmetainfo dst=null perm=null
2013-10-31 16:06:02,428 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46863, bytes: 187, op: HDFS_READ, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1293847835140075373_1033, duration: 355972
2013-10-31 16:06:02,431 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0003 = 19. Number of splits = 5
2013-10-31 16:06:02,432 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,432 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,432 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,432 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,433 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,434 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,435 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,435 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0003_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:02,435 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0003 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:02,436 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0003 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:06:02,851 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2999485849396669780_1021 file build/test/data/dfs/data/data7/current/blk_-2999485849396669780 for deletion
2013-10-31 16:06:02,851 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2674703006665761127_1018 file build/test/data/dfs/data/data8/current/blk_-2674703006665761127 for deletion
2013-10-31 16:06:02,851 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2999485849396669780_1021 at file build/test/data/dfs/data/data7/current/blk_-2999485849396669780
2013-10-31 16:06:02,852 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2325358903431004453_1020 file build/test/data/dfs/data/data8/current/blk_-2325358903431004453 for deletion
2013-10-31 16:06:02,852 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2674703006665761127_1018 at file build/test/data/dfs/data/data8/current/blk_-2674703006665761127
2013-10-31 16:06:02,852 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_697700709896827018_1019 file build/test/data/dfs/data/data7/current/blk_697700709896827018 for deletion
2013-10-31 16:06:02,852 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2325358903431004453_1020 at file build/test/data/dfs/data/data8/current/blk_-2325358903431004453
2013-10-31 16:06:02,853 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_697700709896827018_1019 at file build/test/data/dfs/data/data7/current/blk_697700709896827018
2013-10-31 16:06:03,133 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0003_m_000006_0' to tip task_20131031160444934_0003_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:03,138 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000000_0'
2013-10-31 16:06:03,138 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000001_0'
2013-10-31 16:06:03,138 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000006_0'
2013-10-31 16:06:03,141 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000002_0'
2013-10-31 16:06:03,142 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:03,142 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0002_m_000003_0'
2013-10-31 16:06:03,142 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000006_0 which needs 1 slots
2013-10-31 16:06:03,143 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000006_0 which needs 1 slots
2013-10-31 16:06:03,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken dst=null perm=null
2013-10-31 16:06:03,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53867, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6141873193401928131_1037, duration: 373823
2013-10-31 16:06:03,156 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-205831684819831428_1031 to datanode(s) 127.0.0.1:38271
2013-10-31 16:06:03,157 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5382160867474461323_1024
2013-10-31 16:06:03,157 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-5382160867474461323_1024
2013-10-31 16:06:03,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml dst=null perm=null
2013-10-31 16:06:03,169 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46866, bytes: 29592, op: HDFS_READ, cliID: DFSClient_2118860654, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 488157
2013-10-31 16:06:03,202 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:03,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar dst=null perm=null
2013-10-31 16:06:03,242 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33765, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2118860654, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-205831684819831428_1031, duration: 2525559
2013-10-31 16:06:03,353 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:06:03,361 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10457 with signal TERM. Exit code 0
2013-10-31 16:06:03,361 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-978688131
2013-10-31 16:06:03,362 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-978688131 spawned.
2013-10-31 16:06:03,364 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000006_0/taskjvm.sh
2013-10-31 16:06:03,614 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0002_m_1252934869
2013-10-31 16:06:03,802 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:03,802 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:03,802 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:03,802 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_1252934869 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:06:04,538 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-978688131 given task: attempt_20131031160444934_0003_m_000006_0
2013-10-31 16:06:05,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:05,373 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:05,373 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000005_0 not found in cache
2013-10-31 16:06:05,374 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000004_0 not found in cache
2013-10-31 16:06:05,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0002 for user-log deletion with retainTimeStamp:1383321965376
2013-10-31 16:06:05,650 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5382160867474461323_1024 file build/test/data/dfs/data/data1/current/blk_-5382160867474461323 for deletion
2013-10-31 16:06:05,651 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5382160867474461323_1024 at file build/test/data/dfs/data/data1/current/blk_-5382160867474461323
2013-10-31 16:06:05,777 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_-541739399 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:05,787 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10765 with signal TERM. Exit code 0
2013-10-31 16:06:05,852 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-205831684819831428_1031 to 127.0.0.1:38271
2013-10-31 16:06:05,852 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5382160867474461323_1024 file build/test/data/dfs/data/data7/current/blk_-5382160867474461323 for deletion
2013-10-31 16:06:05,853 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5382160867474461323_1024 at file build/test/data/dfs/data/data7/current/blk_-5382160867474461323
2013-10-31 16:06:05,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-205831684819831428_1031 src: /127.0.0.1:33837 dest: /127.0.0.1:38271
2013-10-31 16:06:05,855 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-205831684819831428_1031 to /127.0.0.1:38271
2013-10-31 16:06:05,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-205831684819831428_1031 src: /127.0.0.1:33837 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:06:05,860 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-205831684819831428_1031 size 238055
2013-10-31 16:06:05,968 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:05,968 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:05,968 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:05,968 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_-541739399 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:06,158 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-5382160867474461323_1024
2013-10-31 16:06:06,675 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_266027598 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:06,685 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10938 with signal TERM. Exit code 0
2013-10-31 16:06:06,838 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:06,839 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:06,839 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:06,839 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_266027598 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:06,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5382160867474461323_1024 file build/test/data/dfs/data/data6/current/blk_-5382160867474461323 for deletion
2013-10-31 16:06:06,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5382160867474461323_1024 at file build/test/data/dfs/data/data6/current/blk_-5382160867474461323
2013-10-31 16:06:07,952 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000006_0 0.0% setup
2013-10-31 16:06:07,955 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000006_0 is done.
2013-10-31 16:06:07,956 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000006_0 was -1
2013-10-31 16:06:07,956 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:08,143 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:08,143 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000001_0 not found in cache
2013-10-31 16:06:08,143 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0002
2013-10-31 16:06:08,143 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000000_0 not found in cache
2013-10-31 16:06:08,144 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000002_0 not found in cache
2013-10-31 16:06:08,144 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0002_m_000003_0 not found in cache
2013-10-31 16:06:08,144 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0002 for user-log deletion with retainTimeStamp:1383321968144
2013-10-31 16:06:08,145 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0002 for user-log deletion with retainTimeStamp:1383321968144
2013-10-31 16:06:08,281 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_88478447 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:08,291 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10688 with signal TERM. Exit code 0
2013-10-31 16:06:08,488 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:08,489 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:08,489 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:08,489 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_88478447 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:08,639 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0002_m_955433630 since job job_20131031160444934_0002 is dead
2013-10-31 16:06:08,649 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10727 with signal TERM. Exit code 0
2013-10-31 16:06:08,842 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:08,842 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:08,842 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:08,842 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_955433630 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:09,150 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000006_0' has completed task_20131031160444934_0003_m_000006 successfully.
2013-10-31 16:06:09,153 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000000_0' to tip task_20131031160444934_0003_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:09,154 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000000
2013-10-31 16:06:09,154 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000001_0' to tip task_20131031160444934_0003_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:09,155 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000001
2013-10-31 16:06:09,157 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000002_0' to tip task_20131031160444934_0003_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:09,157 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:06:09,158 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000002
2013-10-31 16:06:09,158 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:06:09,158 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000003_0' to tip task_20131031160444934_0003_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:09,158 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000000_0 which needs 1 slots
2013-10-31 16:06:09,159 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000000_0 which needs 1 slots
2013-10-31 16:06:09,159 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000003
2013-10-31 16:06:09,159 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000001_0 which needs 1 slots
2013-10-31 16:06:09,159 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0003_m_000001_0 which needs 1 slots
2013-10-31 16:06:09,164 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:06:09,166 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:06:09,167 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000002_0 which needs 1 slots
2013-10-31 16:06:09,167 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000002_0 which needs 1 slots
2013-10-31 16:06:09,167 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000003_0 which needs 1 slots
2013-10-31 16:06:09,167 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0003_m_000003_0 which needs 1 slots
2013-10-31 16:06:09,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken dst=null perm=null
2013-10-31 16:06:09,180 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46871, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6141873193401928131_1037, duration: 350373
2013-10-31 16:06:09,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml dst=null perm=null
2013-10-31 16:06:09,190 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0003/attempt_20131031160444934_0003_m_000001_0. Attempting to reuse: jvm_20131031160444934_0003_m_-978688131
2013-10-31 16:06:09,191 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0002_m_481603449
2013-10-31 16:06:09,194 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46873, bytes: 29592, op: HDFS_READ, cliID: DFSClient_-2056367726, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1007983707836522264_1034, duration: 571929
2013-10-31 16:06:09,196 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group10599 with signal TERM. Exit code 0
2013-10-31 16:06:09,197 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-2067127539
2013-10-31 16:06:09,198 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-2067127539 spawned.
2013-10-31 16:06:09,200 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000000_0/taskjvm.sh
2013-10-31 16:06:09,270 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:09,277 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:09,277 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:09,277 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:09,277 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0002_m_481603449 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:09,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar dst=null perm=null
2013-10-31 16:06:09,295 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53877, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2056367726, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-205831684819831428_1031, duration: 1209882
2013-10-31 16:06:09,360 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-1219933498
2013-10-31 16:06:09,361 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-1219933498 spawned.
2013-10-31 16:06:09,361 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_-1716222122
2013-10-31 16:06:09,362 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_-1716222122 spawned.
2013-10-31 16:06:09,362 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000003_0/taskjvm.sh
2013-10-31 16:06:09,363 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000002_0/taskjvm.sh
2013-10-31 16:06:09,382 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0003_m_000004_0' to tip task_20131031160444934_0003_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:06:09,382 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0003_m_000004
2013-10-31 16:06:09,384 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:06:09,385 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000004_0 which needs 1 slots
2013-10-31 16:06:09,385 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000004_0 which needs 1 slots
2013-10-31 16:06:09,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003/jobToken dst=null perm=null
2013-10-31 16:06:09,389 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46875, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6141873193401928131_1037, duration: 158850
2013-10-31 16:06:09,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.xml dst=null perm=null
2013-10-31 16:06:09,395 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33844, bytes: 29592, op: HDFS_READ, cliID: DFSClient_908427599, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1007983707836522264_1034, duration: 203728
2013-10-31 16:06:09,409 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:09,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.jar dst=null perm=null
2013-10-31 16:06:09,429 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46878, bytes: 239915, op: HDFS_READ, cliID: DFSClient_908427599, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-205831684819831428_1031, duration: 1188757
2013-10-31 16:06:09,519 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-978688131 given task: attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:09,549 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_398315277
2013-10-31 16:06:09,551 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_398315277 spawned.
2013-10-31 16:06:09,553 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000004_0/taskjvm.sh
2013-10-31 16:06:09,863 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8580097153134000137_1001
2013-10-31 16:06:10,083 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-2067127539 given task: attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:10,332 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-1219933498 given task: attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:10,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=null
2013-10-31 16:06:10,587 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33849, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 251073
2013-10-31 16:06:10,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:10,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=null
2013-10-31 16:06:10,844 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33851, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 286595
2013-10-31 16:06:10,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:10,885 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46885, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 312235
2013-10-31 16:06:11,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:11,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:11,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:11,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:11,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=null
2013-10-31 16:06:11,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33785, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7021115318436035076_1032, duration: 213144
2013-10-31 16:06:11,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:11,198 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46888, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 158608
2013-10-31 16:06:11,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:11,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:11,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=null
2013-10-31 16:06:11,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:11,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:11,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:11,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:11,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:11,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:11,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=null
2013-10-31 16:06:11,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53892, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6755368884408234344_1025, duration: 146284
2013-10-31 16:06:11,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:11,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:11,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:11,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:11,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:11,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:11,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:11,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33857, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6755368884408234344_1025, duration: 161980
2013-10-31 16:06:11,374 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33858, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-281896601574383084_1026, duration: 132979
2013-10-31 16:06:11,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:11,377 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33859, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 118450
2013-10-31 16:06:11,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:11,380 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33791, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7841801315324419468_1028, duration: 118944
2013-10-31 16:06:11,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:11,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46894, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4456889479922960183_1029, duration: 117287
2013-10-31 16:06:11,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:11,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:11,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:11,389 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33793, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 121635
2013-10-31 16:06:11,391 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46896, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 127200
2013-10-31 16:06:11,392 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46897, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 117358
2013-10-31 16:06:11,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:11,394 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53901, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7989246260074545108_1027, duration: 126591
2013-10-31 16:06:11,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:11,398 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53902, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 204448
2013-10-31 16:06:11,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:11,403 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46900, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4456889479922960183_1029, duration: 152320
2013-10-31 16:06:11,404 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000. blk_-8753219517823030001_1040
2013-10-31 16:06:11,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:11,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:11,410 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33869, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 128548
2013-10-31 16:06:11,419 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003. blk_4031594352087008341_1040
2013-10-31 16:06:11,439 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8753219517823030001_1040 src: /127.0.0.1:33868 dest: /127.0.0.1:38271
2013-10-31 16:06:11,440 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8753219517823030001_1040 src: /127.0.0.1:53907 dest: /127.0.0.1:41648
2013-10-31 16:06:11,440 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8753219517823030001_1040 src: /127.0.0.1:46905 dest: /127.0.0.1:47311
2013-10-31 16:06:11,443 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46905, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8753219517823030001_1040, duration: 1762018
2013-10-31 16:06:11,443 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8753219517823030001_1040 terminating
2013-10-31 16:06:11,443 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53907, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8753219517823030001_1040, duration: 2108970
2013-10-31 16:06:11,443 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8753219517823030001_1040 terminating
2013-10-31 16:06:11,444 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33868, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8753219517823030001_1040, duration: 2423196
2013-10-31 16:06:11,444 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8753219517823030001_1040 terminating
2013-10-31 16:06:11,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4031594352087008341_1040 src: /127.0.0.1:33801 dest: /127.0.0.1:50942
2013-10-31 16:06:11,445 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8753219517823030001_1040 size 12
2013-10-31 16:06:11,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4031594352087008341_1040 src: /127.0.0.1:33873 dest: /127.0.0.1:38271
2013-10-31 16:06:11,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4031594352087008341_1040 src: /127.0.0.1:53910 dest: /127.0.0.1:41648
2013-10-31 16:06:11,447 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8753219517823030001_1040 size 12
2013-10-31 16:06:11,447 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8753219517823030001_1040 size 12
2013-10-31 16:06:11,449 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53910, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4031594352087008341_1040, duration: 1529782
2013-10-31 16:06:11,449 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4031594352087008341_1040 terminating
2013-10-31 16:06:11,449 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33873, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4031594352087008341_1040, duration: 1892427
2013-10-31 16:06:11,449 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4031594352087008341_1040 terminating
2013-10-31 16:06:11,449 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33801, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4031594352087008341_1040, duration: 2242040
2013-10-31 16:06:11,450 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4031594352087008341_1040 terminating
2013-10-31 16:06:11,450 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4031594352087008341_1040 size 12
2013-10-31 16:06:11,450 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:11,451 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:11,452 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4031594352087008341_1040 size 12
2013-10-31 16:06:11,454 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4031594352087008341_1040 size 12
2013-10-31 16:06:11,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=null
2013-10-31 16:06:11,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:11,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:11,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:11,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:11,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:11,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:11,487 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46908, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6755368884408234344_1025, duration: 201403
2013-10-31 16:06:11,500 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:11,500 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000003_0 0.0%
2013-10-31 16:06:11,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:11,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46909, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 166462
2013-10-31 16:06:11,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:11,508 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46910, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7989246260074545108_1027, duration: 126465
2013-10-31 16:06:11,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:11,511 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46911, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7841801315324419468_1028, duration: 120448
2013-10-31 16:06:11,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:11,514 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33810, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4456889479922960183_1029, duration: 122312
2013-10-31 16:06:11,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:11,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:11,520 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46913, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 123863
2013-10-31 16:06:11,529 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001. blk_7217921539428146541_1040
2013-10-31 16:06:11,544 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7217921539428146541_1040 src: /127.0.0.1:33881 dest: /127.0.0.1:38271
2013-10-31 16:06:11,545 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7217921539428146541_1040 src: /127.0.0.1:53918 dest: /127.0.0.1:41648
2013-10-31 16:06:11,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7217921539428146541_1040 src: /127.0.0.1:33814 dest: /127.0.0.1:50942
2013-10-31 16:06:11,549 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33814, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7217921539428146541_1040, duration: 1263055
2013-10-31 16:06:11,549 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7217921539428146541_1040 terminating
2013-10-31 16:06:11,549 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53918, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7217921539428146541_1040, duration: 1644617
2013-10-31 16:06:11,549 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7217921539428146541_1040 terminating
2013-10-31 16:06:11,549 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33881, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7217921539428146541_1040, duration: 2026638
2013-10-31 16:06:11,549 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7217921539428146541_1040 terminating
2013-10-31 16:06:11,553 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7217921539428146541_1040 size 12
2013-10-31 16:06:11,553 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7217921539428146541_1040 size 12
2013-10-31 16:06:11,553 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7217921539428146541_1040 size 12
2013-10-31 16:06:11,845 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_-1716222122 given task: attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:11,846 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:11,846 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:11,892 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:11,893 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000000_0 0.0%
2013-10-31 16:06:11,900 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_398315277 given task: attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:11,952 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:11,953 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:11,989 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:11,989 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000001_0 0.0%
2013-10-31 16:06:12,160 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000000_0
2013-10-31 16:06:12,161 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000001_0
2013-10-31 16:06:12,165 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000003_0
2013-10-31 16:06:12,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=null
2013-10-31 16:06:12,355 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46920, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7021115318436035076_1032, duration: 200764
2013-10-31 16:06:12,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:12,395 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33820, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 145699
2013-10-31 16:06:12,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003/job.split dst=null perm=null
2013-10-31 16:06:12,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33890, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7021115318436035076_1032, duration: 209523
2013-10-31 16:06:12,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0 dst=null perm=null
2013-10-31 16:06:12,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:12,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46924, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 353537
2013-10-31 16:06:12,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000003_0 dst=null perm=null
2013-10-31 16:06:12,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0 dst=null perm=null
2013-10-31 16:06:12,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:12,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:12,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=null
2013-10-31 16:06:12,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000000_0 dst=null perm=null
2013-10-31 16:06:12,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=null
2013-10-31 16:06:12,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:12,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:12,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:12,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:12,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:12,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:12,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:12,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:12,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:12,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:12,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:12,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00000 dst=null perm=null
2013-10-31 16:06:12,926 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33892, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6755368884408234344_1025, duration: 138636
2013-10-31 16:06:12,928 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46926, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6755368884408234344_1025, duration: 124028
2013-10-31 16:06:12,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:12,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00001 dst=null perm=null
2013-10-31 16:06:12,943 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46927, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-281896601574383084_1026, duration: 127597
2013-10-31 16:06:12,945 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33895, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-281896601574383084_1026, duration: 119333
2013-10-31 16:06:12,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:12,946 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33896, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 124221
2013-10-31 16:06:12,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00002 dst=null perm=null
2013-10-31 16:06:12,948 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33897, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7989246260074545108_1027, duration: 166460
2013-10-31 16:06:12,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:12,950 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53934, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 177761
2013-10-31 16:06:12,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00003 dst=null perm=null
2013-10-31 16:06:12,951 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53935, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7841801315324419468_1028, duration: 121501
2013-10-31 16:06:12,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:12,953 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53936, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4456889479922960183_1029, duration: 174016
2013-10-31 16:06:12,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD/part-00004 dst=null perm=null
2013-10-31 16:06:12,954 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53937, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4456889479922960183_1029, duration: 117324
2013-10-31 16:06:12,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:12,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:12,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:12,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:12,959 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46935, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 172666
2013-10-31 16:06:12,960 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33834, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 123910
2013-10-31 16:06:12,968 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002. blk_8834235696794734646_1042
2013-10-31 16:06:12,969 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004. blk_8499570046378324937_1042
2013-10-31 16:06:12,991 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8834235696794734646_1042 src: /127.0.0.1:46937 dest: /127.0.0.1:47311
2013-10-31 16:06:12,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8499570046378324937_1042 src: /127.0.0.1:46938 dest: /127.0.0.1:47311
2013-10-31 16:06:12,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8834235696794734646_1042 src: /127.0.0.1:33906 dest: /127.0.0.1:38271
2013-10-31 16:06:12,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8499570046378324937_1042 src: /127.0.0.1:33838 dest: /127.0.0.1:50942
2013-10-31 16:06:12,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8834235696794734646_1042 src: /127.0.0.1:53944 dest: /127.0.0.1:41648
2013-10-31 16:06:12,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8499570046378324937_1042 src: /127.0.0.1:33909 dest: /127.0.0.1:38271
2013-10-31 16:06:12,999 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53944, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8834235696794734646_1042, duration: 1041699
2013-10-31 16:06:13,001 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8834235696794734646_1042 terminating
2013-10-31 16:06:13,002 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33906, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8834235696794734646_1042, duration: 5812214
2013-10-31 16:06:13,002 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8834235696794734646_1042 terminating
2013-10-31 16:06:13,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0 dst=null perm=null
2013-10-31 16:06:13,002 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46937, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8834235696794734646_1042, duration: 6174663
2013-10-31 16:06:13,002 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8834235696794734646_1042 terminating
2013-10-31 16:06:13,003 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33909, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8499570046378324937_1042, duration: 5232021
2013-10-31 16:06:13,009 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8499570046378324937_1042 terminating
2013-10-31 16:06:13,009 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8834235696794734646_1042 size 12
2013-10-31 16:06:13,009 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33838, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8499570046378324937_1042, duration: 13488716
2013-10-31 16:06:13,010 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:13,010 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8499570046378324937_1042 terminating
2013-10-31 16:06:13,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:13,011 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:13,011 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46938, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0003_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8499570046378324937_1042, duration: 11945314
2013-10-31 16:06:13,011 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8834235696794734646_1042 size 12
2013-10-31 16:06:13,011 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8499570046378324937_1042 terminating
2013-10-31 16:06:13,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8834235696794734646_1042 size 12
2013-10-31 16:06:13,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8499570046378324937_1042 size 12
2013-10-31 16:06:13,013 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8499570046378324937_1042 size 12
2013-10-31 16:06:13,013 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8499570046378324937_1042 size 12
2013-10-31 16:06:13,014 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:13,014 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:13,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:13,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000001_0 dst=null perm=null
2013-10-31 16:06:13,076 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:13,077 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000002_0 0.0%
2013-10-31 16:06:13,079 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0003_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:13,079 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000004_0 0.0%
2013-10-31 16:06:13,515 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:06:13,517 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000000_0 is done.
2013-10-31 16:06:13,518 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000000_0 was -1
2013-10-31 16:06:13,518 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:13,764 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:06:13,765 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000003_0 is done.
2013-10-31 16:06:13,765 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000003_0 was -1
2013-10-31 16:06:13,766 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:14,111 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:06:14,113 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000001_0 is done.
2013-10-31 16:06:14,113 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000001_0 was -1
2013-10-31 16:06:14,113 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:14,158 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0003_m_000006_0
2013-10-31 16:06:14,159 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0003_m_000006_0
2013-10-31 16:06:14,159 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000006_0 not found in cache
2013-10-31 16:06:15,164 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000000_0' has completed task_20131031160444934_0003_m_000000 successfully.
2013-10-31 16:06:15,166 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000001_0' has completed task_20131031160444934_0003_m_000001 successfully.
2013-10-31 16:06:15,169 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000003_0' has completed task_20131031160444934_0003_m_000003 successfully.
2013-10-31 16:06:15,172 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000002_0
2013-10-31 16:06:15,390 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0003_m_000004_0
2013-10-31 16:06:16,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0 dst=null perm=null
2013-10-31 16:06:16,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:16,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0 dst=null perm=null
2013-10-31 16:06:16,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:16,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:16,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:16,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000002_0 dst=null perm=null
2013-10-31 16:06:16,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/_attempt_20131031160444934_0003_m_000004_0 dst=null perm=null
2013-10-31 16:06:18,346 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:06:18,348 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:06:18,350 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000002_0 is done.
2013-10-31 16:06:18,351 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000002_0 was -1
2013-10-31 16:06:18,351 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:18,465 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:06:18,466 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:06:18,467 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000004_0 is done.
2013-10-31 16:06:18,467 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000004_0 was -1
2013-10-31 16:06:18,467 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:18,876 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-1293847835140075373_1033
2013-10-31 16:06:21,180 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000002_0' has completed task_20131031160444934_0003_m_000002 successfully.
2013-10-31 16:06:21,399 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000004_0' has completed task_20131031160444934_0003_m_000004 successfully.
2013-10-31 16:06:21,404 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0003_m_000005_0' to tip task_20131031160444934_0003_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:06:21,406 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0003_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:06:21,406 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0003_m_000005_0 which needs 1 slots
2013-10-31 16:06:21,406 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0003_m_000005_0 which needs 1 slots
2013-10-31 16:06:21,439 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0003_m_1233721901
2013-10-31 16:06:21,439 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0003_m_1233721901 spawned.
2013-10-31 16:06:21,442 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0003/attempt_20131031160444934_0003_m_000005_0/taskjvm.sh
2013-10-31 16:06:22,368 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0003_m_1233721901 given task: attempt_20131031160444934_0003_m_000005_0
2013-10-31 16:06:22,872 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000005_0 0.0%
2013-10-31 16:06:23,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary dst=null perm=null
2013-10-31 16:06:23,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:23,583 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS from client DFSClient_attempt_20131031160444934_0003_m_000005_0
2013-10-31 16:06:23,583 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0003_m_000005_0
2013-10-31 16:06:23,589 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,589 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:23,589 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,589 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-205831684819831428 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,590 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,590 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,590 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:23,590 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7021115318436035076 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,590 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1293847835140075373 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,591 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1293847835140075373 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,591 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1293847835140075373 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,591 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1007983707836522264 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:23,591 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1007983707836522264 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:23,591 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1007983707836522264 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:23,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0003 dst=null perm=null
2013-10-31 16:06:24,161 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_1007983707836522264_1034 blk_-205831684819831428_1031 blk_-7021115318436035076_1032 blk_-1293847835140075373_1033
2013-10-31 16:06:24,161 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-205831684819831428_1031 blk_-7021115318436035076_1032
2013-10-31 16:06:24,869 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data6/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:24,869 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1293847835140075373_1033 file build/test/data/dfs/data/data5/current/blk_-1293847835140075373 for deletion
2013-10-31 16:06:24,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data6/current/blk_-7021115318436035076
2013-10-31 16:06:24,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data5/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:24,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1293847835140075373_1033 at file build/test/data/dfs/data/data5/current/blk_-1293847835140075373
2013-10-31 16:06:24,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1007983707836522264_1034 file build/test/data/dfs/data/data6/current/blk_1007983707836522264 for deletion
2013-10-31 16:06:24,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1007983707836522264_1034 at file build/test/data/dfs/data/data6/current/blk_1007983707836522264
2013-10-31 16:06:24,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data5/current/blk_-205831684819831428
2013-10-31 16:06:25,807 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0003_m_000005_0 0.0% cleanup
2013-10-31 16:06:25,809 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0003_m_000005_0 is done.
2013-10-31 16:06:25,809 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0003_m_000005_0 was -1
2013-10-31 16:06:25,809 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:26,859 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data8/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:26,859 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data7/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:26,860 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data8/current/blk_-7021115318436035076
2013-10-31 16:06:26,860 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data7/current/blk_-205831684819831428
2013-10-31 16:06:27,162 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_1007983707836522264_1034 blk_-205831684819831428_1031 blk_-7021115318436035076_1032 blk_-1293847835140075373_1033
2013-10-31 16:06:27,162 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_1007983707836522264_1034 blk_-205831684819831428_1031 blk_-7021115318436035076_1032 blk_-1293847835140075373_1033
2013-10-31 16:06:27,244 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data4/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:27,244 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1293847835140075373_1033 file build/test/data/dfs/data/data3/current/blk_-1293847835140075373 for deletion
2013-10-31 16:06:27,244 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data4/current/blk_-7021115318436035076
2013-10-31 16:06:27,245 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1293847835140075373_1033 at file build/test/data/dfs/data/data3/current/blk_-1293847835140075373
2013-10-31 16:06:27,245 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data3/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:27,245 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1007983707836522264_1034 file build/test/data/dfs/data/data4/current/blk_1007983707836522264 for deletion
2013-10-31 16:06:27,245 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data3/current/blk_-205831684819831428
2013-10-31 16:06:27,246 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1007983707836522264_1034 at file build/test/data/dfs/data/data4/current/blk_1007983707836522264
2013-10-31 16:06:27,414 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0003_m_000005_0' has completed task_20131031160444934_0003_m_000005 successfully.
2013-10-31 16:06:27,415 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0003 has completed successfully.
2013-10-31 16:06:27,416 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0003,submitTime=1383235561444,launchTime=1383235562435,firstMapTaskLaunchTime=1383235569153,firstJobSetupTaskLaunchTime=1383235563133,firstJobCleanupTaskLaunchTime=1383235581403,finishTime=1383235587415,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[4D6DBE4C00904663A16DE2E5B8D6F5BD/54A2E4C0D285427AB194FC63FA992B27] upper1*upper2*lower/(1/2) ...rm/joinaroundjoinleftmost
2013-10-31 16:06:27,429 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A. blk_8193787226386140526_1043
2013-10-31 16:06:27,431 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8193787226386140526_1043 src: /127.0.0.1:46946 dest: /127.0.0.1:47311
2013-10-31 16:06:27,434 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8193787226386140526_1043 src: /127.0.0.1:33914 dest: /127.0.0.1:38271
2013-10-31 16:06:27,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8193787226386140526_1043 src: /127.0.0.1:33846 dest: /127.0.0.1:50942
2013-10-31 16:06:27,445 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33846, dest: /127.0.0.1:50942, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8193787226386140526_1043, duration: 5784381
2013-10-31 16:06:27,445 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8193787226386140526_1043 terminating
2013-10-31 16:06:27,446 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33914, dest: /127.0.0.1:38271, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8193787226386140526_1043, duration: 3875066
2013-10-31 16:06:27,446 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8193787226386140526_1043 terminating
2013-10-31 16:06:27,446 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8193787226386140526_1043 size 26369
2013-10-31 16:06:27,447 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46946, dest: /127.0.0.1:47311, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_954571228, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8193787226386140526_1043, duration: 5587460
2013-10-31 16:06:27,447 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8193787226386140526_1043 terminating
2013-10-31 16:06:27,452 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8193787226386140526_1043 size 26369
2013-10-31 16:06:27,452 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A from client DFSClient_954571228
2013-10-31 16:06:27,453 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_logs/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A is closed by DFSClient_954571228
2013-10-31 16:06:27,453 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8193787226386140526_1043 size 26369
2013-10-31 16:06:27,461 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0003_1383235561444_hadoop_%5B4D6DBE4C00904663A16DE2E5B8D6F5BD%2F54A2E4C0D285427A to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:27,462 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000004_0'
2013-10-31 16:06:27,463 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000005_0'
2013-10-31 16:06:27,464 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6141873193401928131 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,464 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6141873193401928131 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,465 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6141873193401928131 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0003 dst=null perm=null
2013-10-31 16:06:27,472 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-685171818103965493 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,472 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0003_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:27,472 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-685171818103965493 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,472 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-685171818103965493 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,473 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6715209515672176699 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,473 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6715209515672176699 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,473 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6715209515672176699 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,473 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6755368884408234344 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,474 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6755368884408234344 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,474 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6755368884408234344 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,474 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-281896601574383084 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,474 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-281896601574383084 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,474 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-281896601574383084 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,475 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7989246260074545108 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:27,475 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7989246260074545108 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,475 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7989246260074545108 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,475 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7841801315324419468 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,476 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7841801315324419468 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,476 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7841801315324419468 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,476 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4456889479922960183 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:27,476 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4456889479922960183 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:27,476 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4456889479922960183 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:27,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5275500297_upper2_ED2993862B254BB9A525951B665C2DAD dst=null perm=null
2013-10-31 16:06:27,484 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary
2013-10-31 16:06:27,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2013-10-31 16:06:27,509 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:27,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2013-10-31 16:06:27,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2013-10-31 16:06:27,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2013-10-31 16:06:27,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2013-10-31 16:06:27,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2013-10-31 16:06:27,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2013-10-31 16:06:27,517 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46950, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8753219517823030001_1040, duration: 357287
2013-10-31 16:06:27,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2013-10-31 16:06:27,520 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33918, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7217921539428146541_1040, duration: 152965
2013-10-31 16:06:27,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2013-10-31 16:06:27,522 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53955, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8834235696794734646_1042, duration: 128875
2013-10-31 16:06:27,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2013-10-31 16:06:27,524 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33851, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4031594352087008341_1040, duration: 129526
2013-10-31 16:06:27,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2013-10-31 16:06:27,526 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33921, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8499570046378324937_1042, duration: 125742
2013-10-31 16:06:27,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2013-10-31 16:06:27,539 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:27,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2013-10-31 16:06:27,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2013-10-31 16:06:27,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2013-10-31 16:06:27,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2013-10-31 16:06:27,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2013-10-31 16:06:27,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2013-10-31 16:06:27,548 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33922, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8753219517823030001_1040, duration: 208044
2013-10-31 16:06:27,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2013-10-31 16:06:27,551 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33923, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7217921539428146541_1040, duration: 250066
2013-10-31 16:06:27,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2013-10-31 16:06:27,553 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33924, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8834235696794734646_1042, duration: 140647
2013-10-31 16:06:27,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2013-10-31 16:06:27,555 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53961, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4031594352087008341_1040, duration: 133469
2013-10-31 16:06:27,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2013-10-31 16:06:27,557 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33926, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8499570046378324937_1042, duration: 131244
2013-10-31 16:06:27,557 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost
2013-10-31 16:06:27,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2013-10-31 16:06:27,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2013-10-31 16:06:27,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46960, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8753219517823030001_1040, duration: 131011
2013-10-31 16:06:27,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2013-10-31 16:06:27,567 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53964, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7217921539428146541_1040, duration: 134465
2013-10-31 16:06:27,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2013-10-31 16:06:27,571 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33929, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8834235696794734646_1042, duration: 350803
2013-10-31 16:06:27,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2013-10-31 16:06:27,576 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33930, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4031594352087008341_1040, duration: 311680
2013-10-31 16:06:27,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2013-10-31 16:06:27,581 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33862, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8499570046378324937_1042, duration: 334481
2013-10-31 16:06:27,605 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:06:27,606 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:06:27,630 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] starting
2013-10-31 16:06:27,631 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:06:27,631 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:06:27,631 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes"]
2013-10-31 16:06:27,632 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] parallel execution is enabled: true
2013-10-31 16:06:27,632 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] starting jobs: 1
2013-10-31 16:06:27,632 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [tail] allocating threads: 1
2013-10-31 16:06:27,633 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [tail] starting step: (1/1) ...ipesplatform/renamedpipes
2013-10-31 16:06:27,639 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:27,639 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:06:27,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:27,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:06:27,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,668 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar. blk_7721447327930509679_1044
2013-10-31 16:06:27,669 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:33863 dest: /127.0.0.1:50942
2013-10-31 16:06:27,671 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:33933 dest: /127.0.0.1:38271
2013-10-31 16:06:27,672 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:46967 dest: /127.0.0.1:47311
2013-10-31 16:06:27,687 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46967, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7721447327930509679_1044, duration: 13039357
2013-10-31 16:06:27,688 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7721447327930509679_1044 terminating
2013-10-31 16:06:27,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33933, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7721447327930509679_1044, duration: 10300012
2013-10-31 16:06:27,689 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7721447327930509679_1044 terminating
2013-10-31 16:06:27,689 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33863, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7721447327930509679_1044, duration: 11255949
2013-10-31 16:06:27,689 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7721447327930509679_1044 terminating
2013-10-31 16:06:27,692 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:27,693 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar from client DFSClient_1457307213
2013-10-31 16:06:27,693 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:27,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:27,694 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:27,699 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar. New replication is 10
2013-10-31 16:06:27,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar dst=null perm=null
2013-10-31 16:06:27,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,714 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:27,720 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:27,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:27,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,735 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split. New replication is 10
2013-10-31 16:06:27,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=null
2013-10-31 16:06:27,743 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split. blk_4985515153484692347_1045
2013-10-31 16:06:27,745 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:33935 dest: /127.0.0.1:38271
2013-10-31 16:06:27,747 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:46969 dest: /127.0.0.1:47311
2013-10-31 16:06:27,748 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:33868 dest: /127.0.0.1:50942
2013-10-31 16:06:27,750 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4985515153484692347_1045 src: /127.0.0.1:53974 dest: /127.0.0.1:41648
2013-10-31 16:06:27,754 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53974, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4985515153484692347_1045, duration: 2513220
2013-10-31 16:06:27,754 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,755 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33868, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4985515153484692347_1045, duration: 1826571
2013-10-31 16:06:27,755 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,756 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46969, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4985515153484692347_1045, duration: 2786000
2013-10-31 16:06:27,756 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,757 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33935, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 3532469
2013-10-31 16:06:27,757 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4985515153484692347_1045 terminating
2013-10-31 16:06:27,760 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,760 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split from client DFSClient_1457307213
2013-10-31 16:06:27,761 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:27,761 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,761 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,762 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4985515153484692347_1045 size 1732
2013-10-31 16:06:27,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:27,780 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo. blk_-2374554834453302461_1046
2013-10-31 16:06:27,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2374554834453302461_1046 src: /127.0.0.1:33939 dest: /127.0.0.1:38271
2013-10-31 16:06:27,784 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2374554834453302461_1046 src: /127.0.0.1:33871 dest: /127.0.0.1:50942
2013-10-31 16:06:27,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2374554834453302461_1046 src: /127.0.0.1:46974 dest: /127.0.0.1:47311
2013-10-31 16:06:27,789 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46974, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2374554834453302461_1046, duration: 572470
2013-10-31 16:06:27,789 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2374554834453302461_1046 terminating
2013-10-31 16:06:27,789 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33871, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2374554834453302461_1046, duration: 1409879
2013-10-31 16:06:27,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2374554834453302461_1046 terminating
2013-10-31 16:06:27,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33939, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2374554834453302461_1046, duration: 2212429
2013-10-31 16:06:27,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2374554834453302461_1046 terminating
2013-10-31 16:06:27,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2374554834453302461_1046 size 183
2013-10-31 16:06:27,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2374554834453302461_1046 size 183
2013-10-31 16:06:27,794 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2374554834453302461_1046 size 183
2013-10-31 16:06:27,794 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:27,795 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:27,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,229 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:28,229 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0003 being deleted.
2013-10-31 16:06:28,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,490 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml. blk_-5693872128215026843_1047
2013-10-31 16:06:28,492 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5693872128215026843_1047 src: /127.0.0.1:46975 dest: /127.0.0.1:47311
2013-10-31 16:06:28,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5693872128215026843_1047 src: /127.0.0.1:53979 dest: /127.0.0.1:41648
2013-10-31 16:06:28,495 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5693872128215026843_1047 src: /127.0.0.1:33875 dest: /127.0.0.1:50942
2013-10-31 16:06:28,499 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33875, dest: /127.0.0.1:50942, bytes: 28374, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5693872128215026843_1047, duration: 1040915
2013-10-31 16:06:28,499 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5693872128215026843_1047 terminating
2013-10-31 16:06:28,500 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5693872128215026843_1047 size 28374
2013-10-31 16:06:28,500 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53979, dest: /127.0.0.1:41648, bytes: 28374, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5693872128215026843_1047, duration: 1828025
2013-10-31 16:06:28,500 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5693872128215026843_1047 terminating
2013-10-31 16:06:28,501 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46975, dest: /127.0.0.1:47311, bytes: 28374, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5693872128215026843_1047, duration: 2901378
2013-10-31 16:06:28,501 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5693872128215026843_1047 terminating
2013-10-31 16:06:28,503 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5693872128215026843_1047 size 28374
2013-10-31 16:06:28,503 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml from client DFSClient_1457307213
2013-10-31 16:06:28,504 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:28,504 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5693872128215026843_1047 size 28374
2013-10-31 16:06:28,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml dst=null perm=null
2013-10-31 16:06:28,520 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33877, bytes: 28598, op: HDFS_READ, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5693872128215026843_1047, duration: 489290
2013-10-31 16:06:28,541 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0004: nMaps=5 nReduces=0 max=-1
2013-10-31 16:06:28,542 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0004 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:28,542 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0004 RESULT=SUCCESS
2013-10-31 16:06:28,542 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0004
2013-10-31 16:06:28,543 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0004
2013-10-31 16:06:28,544 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [tail] submitted hadoop job: job_20131031160444934_0004
2013-10-31 16:06:28,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,580 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml. blk_-6651499441412400141_1049
2013-10-31 16:06:28,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6651499441412400141_1049 src: /127.0.0.1:33878 dest: /127.0.0.1:50942
2013-10-31 16:06:28,584 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6651499441412400141_1049 src: /127.0.0.1:53984 dest: /127.0.0.1:41648
2013-10-31 16:06:28,585 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6651499441412400141_1049 src: /127.0.0.1:33949 dest: /127.0.0.1:38271
2013-10-31 16:06:28,590 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33949, dest: /127.0.0.1:38271, bytes: 28439, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6651499441412400141_1049, duration: 895535
2013-10-31 16:06:28,590 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6651499441412400141_1049 terminating
2013-10-31 16:06:28,591 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6651499441412400141_1049 size 28439
2013-10-31 16:06:28,591 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53984, dest: /127.0.0.1:41648, bytes: 28439, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6651499441412400141_1049, duration: 1841551
2013-10-31 16:06:28,592 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6651499441412400141_1049 terminating
2013-10-31 16:06:28,592 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33878, dest: /127.0.0.1:50942, bytes: 28439, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6651499441412400141_1049, duration: 2907058
2013-10-31 16:06:28,592 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6651499441412400141_1049 terminating
2013-10-31 16:06:28,595 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml from client DFSClient_1479709366
2013-10-31 16:06:28,595 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_conf.xml is closed by DFSClient_1479709366
2013-10-31 16:06:28,596 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6651499441412400141_1049 size 28439
2013-10-31 16:06:28,597 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6651499441412400141_1049 size 28439
2013-10-31 16:06:28,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:28,613 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken. blk_7011938532533120784_1050
2013-10-31 16:06:28,615 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7011938532533120784_1050 src: /127.0.0.1:33881 dest: /127.0.0.1:50942
2013-10-31 16:06:28,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7011938532533120784_1050 src: /127.0.0.1:46984 dest: /127.0.0.1:47311
2013-10-31 16:06:28,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7011938532533120784_1050 src: /127.0.0.1:53988 dest: /127.0.0.1:41648
2013-10-31 16:06:28,621 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:53988, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7011938532533120784_1050, duration: 273578
2013-10-31 16:06:28,622 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7011938532533120784_1050 terminating
2013-10-31 16:06:28,622 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46984, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7011938532533120784_1050, duration: 1121635
2013-10-31 16:06:28,623 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7011938532533120784_1050 terminating
2013-10-31 16:06:28,623 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33881, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7011938532533120784_1050, duration: 1986650
2013-10-31 16:06:28,623 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7011938532533120784_1050 size 116
2013-10-31 16:06:28,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7011938532533120784_1050 terminating
2013-10-31 16:06:28,627 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7011938532533120784_1050 size 116
2013-10-31 16:06:28,627 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7011938532533120784_1050 size 116
2013-10-31 16:06:28,628 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken from client DFSClient_1457307213
2013-10-31 16:06:28,628 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:28,635 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken
2013-10-31 16:06:28,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.splitmetainfo dst=null perm=null
2013-10-31 16:06:28,640 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46986, bytes: 187, op: HDFS_READ, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2374554834453302461_1046, duration: 343409
2013-10-31 16:06:28,644 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0004 = 19. Number of splits = 5
2013-10-31 16:06:28,644 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,644 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,645 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,646 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:28,648 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0004 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:28,648 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0004 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:06:29,658 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7021115318436035076_1032 file build/test/data/dfs/data/data1/current/blk_-7021115318436035076 for deletion
2013-10-31 16:06:29,658 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1293847835140075373_1033 file build/test/data/dfs/data/data2/current/blk_-1293847835140075373 for deletion
2013-10-31 16:06:29,659 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7021115318436035076_1032 at file build/test/data/dfs/data/data1/current/blk_-7021115318436035076
2013-10-31 16:06:29,659 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-205831684819831428_1031 file build/test/data/dfs/data/data1/current/blk_-205831684819831428 for deletion
2013-10-31 16:06:29,659 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1293847835140075373_1033 at file build/test/data/dfs/data/data2/current/blk_-1293847835140075373
2013-10-31 16:06:29,659 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1007983707836522264_1034 file build/test/data/dfs/data/data1/current/blk_1007983707836522264 for deletion
2013-10-31 16:06:29,659 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-205831684819831428_1031 at file build/test/data/dfs/data/data1/current/blk_-205831684819831428
2013-10-31 16:06:29,660 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1007983707836522264_1034 at file build/test/data/dfs/data/data1/current/blk_1007983707836522264
2013-10-31 16:06:30,163 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_7721447327930509679_1044 to datanode(s) 127.0.0.1:41648
2013-10-31 16:06:30,163 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_6715209515672176699_1023 blk_7841801315324419468_1028 blk_-685171818103965493_1030 blk_6141873193401928131_1037 blk_-4456889479922960183_1029
2013-10-31 16:06:30,163 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_6715209515672176699_1023 blk_-685171818103965493_1030 blk_-6755368884408234344_1025 blk_-281896601574383084_1026 blk_7989246260074545108_1027
2013-10-31 16:06:30,187 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0004_m_000006_0' to tip task_20131031160444934_0004_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:30,191 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000000_0'
2013-10-31 16:06:30,191 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000001_0'
2013-10-31 16:06:30,192 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000006_0'
2013-10-31 16:06:30,193 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:30,194 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000006_0 which needs 1 slots
2013-10-31 16:06:30,194 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000006_0 which needs 1 slots
2013-10-31 16:06:30,195 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000002_0'
2013-10-31 16:06:30,195 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0003_m_000003_0'
2013-10-31 16:06:30,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken dst=null perm=null
2013-10-31 16:06:30,202 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46987, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7011938532533120784_1050, duration: 334508
2013-10-31 16:06:30,202 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadDelay 78 raw values into 2 aggregated values, total 7
2013-10-31 16:06:30,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml dst=null perm=null
2013-10-31 16:06:30,213 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:53992, bytes: 28598, op: HDFS_READ, cliID: DFSClient_589832289, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5693872128215026843_1047, duration: 474696
2013-10-31 16:06:30,267 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:30,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar dst=null perm=null
2013-10-31 16:06:30,289 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:46990, bytes: 239915, op: HDFS_READ, cliID: DFSClient_589832289, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7721447327930509679_1044, duration: 1076881
2013-10-31 16:06:30,393 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0003_m_-2067127539
2013-10-31 16:06:30,400 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11239 with signal TERM. Exit code 0
2013-10-31 16:06:30,400 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-1151283590
2013-10-31 16:06:30,400 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-1151283590 spawned.
2013-10-31 16:06:30,404 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000006_0/taskjvm.sh
2013-10-31 16:06:30,489 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:30,490 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:30,490 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:30,490 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-2067127539 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:31,678 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1151283590 given task: attempt_20131031160444934_0004_m_000006_0
2013-10-31 16:06:32,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:32,465 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:32,465 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000005_0 not found in cache
2013-10-31 16:06:32,465 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000004_0 not found in cache
2013-10-31 16:06:32,466 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0003 for user-log deletion with retainTimeStamp:1383321992466
2013-10-31 16:06:32,501 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_398315277 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:32,512 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11421 with signal TERM. Exit code 0
2013-10-31 16:06:32,659 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_7721447327930509679_1044 to 127.0.0.1:41648
2013-10-31 16:06:32,660 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6755368884408234344_1025 file build/test/data/dfs/data/data1/current/blk_-6755368884408234344 for deletion
2013-10-31 16:06:32,660 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-685171818103965493_1030 file build/test/data/dfs/data/data2/current/blk_-685171818103965493 for deletion
2013-10-31 16:06:32,660 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6755368884408234344_1025 at file build/test/data/dfs/data/data1/current/blk_-6755368884408234344
2013-10-31 16:06:32,661 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-685171818103965493_1030 at file build/test/data/dfs/data/data2/current/blk_-685171818103965493
2013-10-31 16:06:32,661 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-281896601574383084_1026 file build/test/data/dfs/data/data2/current/blk_-281896601574383084 for deletion
2013-10-31 16:06:32,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7721447327930509679_1044 src: /127.0.0.1:53997 dest: /127.0.0.1:41648
2013-10-31 16:06:32,662 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-281896601574383084_1026 at file build/test/data/dfs/data/data2/current/blk_-281896601574383084
2013-10-31 16:06:32,662 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6715209515672176699_1023 file build/test/data/dfs/data/data2/current/blk_6715209515672176699 for deletion
2013-10-31 16:06:32,662 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_7721447327930509679_1044 to /127.0.0.1:41648
2013-10-31 16:06:32,663 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6715209515672176699_1023 at file build/test/data/dfs/data/data2/current/blk_6715209515672176699
2013-10-31 16:06:32,662 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7989246260074545108_1027 file build/test/data/dfs/data/data1/current/blk_7989246260074545108 for deletion
2013-10-31 16:06:32,664 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7989246260074545108_1027 at file build/test/data/dfs/data/data1/current/blk_7989246260074545108
2013-10-31 16:06:32,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7721447327930509679_1044 src: /127.0.0.1:53997 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:06:32,670 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7721447327930509679_1044 size 238055
2013-10-31 16:06:32,686 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:32,686 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:32,686 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:32,686 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_398315277 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:32,861 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4456889479922960183_1029 file build/test/data/dfs/data/data7/current/blk_-4456889479922960183 for deletion
2013-10-31 16:06:32,861 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-685171818103965493_1030 file build/test/data/dfs/data/data8/current/blk_-685171818103965493 for deletion
2013-10-31 16:06:32,861 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4456889479922960183_1029 at file build/test/data/dfs/data/data7/current/blk_-4456889479922960183
2013-10-31 16:06:32,862 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6141873193401928131_1037 file build/test/data/dfs/data/data8/current/blk_6141873193401928131 for deletion
2013-10-31 16:06:32,862 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-685171818103965493_1030 at file build/test/data/dfs/data/data8/current/blk_-685171818103965493
2013-10-31 16:06:32,862 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6715209515672176699_1023 file build/test/data/dfs/data/data8/current/blk_6715209515672176699 for deletion
2013-10-31 16:06:32,862 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6141873193401928131_1037 at file build/test/data/dfs/data/data8/current/blk_6141873193401928131
2013-10-31 16:06:32,862 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7841801315324419468_1028 file build/test/data/dfs/data/data8/current/blk_7841801315324419468 for deletion
2013-10-31 16:06:32,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6715209515672176699_1023 at file build/test/data/dfs/data/data8/current/blk_6715209515672176699
2013-10-31 16:06:32,863 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7841801315324419468_1028 at file build/test/data/dfs/data/data8/current/blk_7841801315324419468
2013-10-31 16:06:33,164 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_6715209515672176699_1023 blk_7841801315324419468_1028 blk_-685171818103965493_1030 blk_6141873193401928131_1037 blk_-6755368884408234344_1025 blk_-4456889479922960183_1029 blk_-281896601574383084_1026 blk_7989246260074545108_1027
2013-10-31 16:06:33,164 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_7841801315324419468_1028 blk_6141873193401928131_1037 blk_-6755368884408234344_1025 blk_-4456889479922960183_1029 blk_-281896601574383084_1026 blk_7989246260074545108_1027
2013-10-31 16:06:33,259 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6755368884408234344_1025 file build/test/data/dfs/data/data4/current/blk_-6755368884408234344 for deletion
2013-10-31 16:06:33,259 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4456889479922960183_1029 file build/test/data/dfs/data/data4/current/blk_-4456889479922960183 for deletion
2013-10-31 16:06:33,259 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6755368884408234344_1025 at file build/test/data/dfs/data/data4/current/blk_-6755368884408234344
2013-10-31 16:06:33,259 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-281896601574383084_1026 file build/test/data/dfs/data/data3/current/blk_-281896601574383084 for deletion
2013-10-31 16:06:33,260 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4456889479922960183_1029 at file build/test/data/dfs/data/data4/current/blk_-4456889479922960183
2013-10-31 16:06:33,260 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-281896601574383084_1026 at file build/test/data/dfs/data/data3/current/blk_-281896601574383084
2013-10-31 16:06:33,260 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6141873193401928131_1037 file build/test/data/dfs/data/data4/current/blk_6141873193401928131 for deletion
2013-10-31 16:06:33,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7841801315324419468_1028 file build/test/data/dfs/data/data3/current/blk_7841801315324419468 for deletion
2013-10-31 16:06:33,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6141873193401928131_1037 at file build/test/data/dfs/data/data4/current/blk_6141873193401928131
2013-10-31 16:06:33,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7989246260074545108_1027 file build/test/data/dfs/data/data4/current/blk_7989246260074545108 for deletion
2013-10-31 16:06:33,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7841801315324419468_1028 at file build/test/data/dfs/data/data3/current/blk_7841801315324419468
2013-10-31 16:06:33,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7989246260074545108_1027 at file build/test/data/dfs/data/data4/current/blk_7989246260074545108
2013-10-31 16:06:33,872 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6755368884408234344_1025 file build/test/data/dfs/data/data5/current/blk_-6755368884408234344 for deletion
2013-10-31 16:06:33,873 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4456889479922960183_1029 file build/test/data/dfs/data/data5/current/blk_-4456889479922960183 for deletion
2013-10-31 16:06:33,873 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6755368884408234344_1025 at file build/test/data/dfs/data/data5/current/blk_-6755368884408234344
2013-10-31 16:06:33,873 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-685171818103965493_1030 file build/test/data/dfs/data/data6/current/blk_-685171818103965493 for deletion
2013-10-31 16:06:33,873 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4456889479922960183_1029 at file build/test/data/dfs/data/data5/current/blk_-4456889479922960183
2013-10-31 16:06:33,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-281896601574383084_1026 file build/test/data/dfs/data/data6/current/blk_-281896601574383084 for deletion
2013-10-31 16:06:33,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-685171818103965493_1030 at file build/test/data/dfs/data/data6/current/blk_-685171818103965493
2013-10-31 16:06:33,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6141873193401928131_1037 file build/test/data/dfs/data/data5/current/blk_6141873193401928131 for deletion
2013-10-31 16:06:33,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-281896601574383084_1026 at file build/test/data/dfs/data/data6/current/blk_-281896601574383084
2013-10-31 16:06:33,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6715209515672176699_1023 file build/test/data/dfs/data/data5/current/blk_6715209515672176699 for deletion
2013-10-31 16:06:33,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6141873193401928131_1037 at file build/test/data/dfs/data/data5/current/blk_6141873193401928131
2013-10-31 16:06:33,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7841801315324419468_1028 file build/test/data/dfs/data/data6/current/blk_7841801315324419468 for deletion
2013-10-31 16:06:33,875 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_1233721901 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:33,876 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7841801315324419468_1028 at file build/test/data/dfs/data/data6/current/blk_7841801315324419468
2013-10-31 16:06:33,876 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7989246260074545108_1027 file build/test/data/dfs/data/data5/current/blk_7989246260074545108 for deletion
2013-10-31 16:06:33,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6715209515672176699_1023 at file build/test/data/dfs/data/data5/current/blk_6715209515672176699
2013-10-31 16:06:33,878 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7989246260074545108_1027 at file build/test/data/dfs/data/data5/current/blk_7989246260074545108
2013-10-31 16:06:33,887 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11604 with signal TERM. Exit code 0
2013-10-31 16:06:34,070 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:34,070 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:34,070 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:34,070 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_1233721901 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:35,130 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000006_0 0.0% setup
2013-10-31 16:06:35,133 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000006_0 is done.
2013-10-31 16:06:35,133 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000006_0 was -1
2013-10-31 16:06:35,134 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:35,194 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:35,194 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000000_0 not found in cache
2013-10-31 16:06:35,195 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000001_0 not found in cache
2013-10-31 16:06:35,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0003 for user-log deletion with retainTimeStamp:1383321995195
2013-10-31 16:06:35,196 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0003
2013-10-31 16:06:35,196 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000002_0 not found in cache
2013-10-31 16:06:35,196 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0003_m_000003_0 not found in cache
2013-10-31 16:06:35,197 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0003 for user-log deletion with retainTimeStamp:1383321995197
2013-10-31 16:06:35,328 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_-1219933498 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:35,338 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11308 with signal TERM. Exit code 0
2013-10-31 16:06:35,390 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_-1716222122 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:35,399 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11380 with signal TERM. Exit code 0
2013-10-31 16:06:35,527 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:35,527 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:35,528 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:35,528 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-1219933498 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:35,542 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:35,542 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:35,543 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:35,543 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-1716222122 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:35,669 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0003_m_-978688131 since job job_20131031160444934_0003 is dead
2013-10-31 16:06:35,679 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11091 with signal TERM. Exit code 0
2013-10-31 16:06:35,928 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:35,928 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:35,929 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:35,929 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0003_m_-978688131 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:06:36,199 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000006_0' has completed task_20131031160444934_0004_m_000006 successfully.
2013-10-31 16:06:36,203 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000000_0' to tip task_20131031160444934_0004_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:36,204 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000000
2013-10-31 16:06:36,205 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000001_0' to tip task_20131031160444934_0004_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:36,205 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000001
2013-10-31 16:06:36,207 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000002_0' to tip task_20131031160444934_0004_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:36,209 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:06:36,209 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000002
2013-10-31 16:06:36,210 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:06:36,210 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000003_0' to tip task_20131031160444934_0004_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:36,210 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000000_0 which needs 1 slots
2013-10-31 16:06:36,210 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000003
2013-10-31 16:06:36,211 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000000_0 which needs 1 slots
2013-10-31 16:06:36,211 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000001_0 which needs 1 slots
2013-10-31 16:06:36,211 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0004_m_000001_0 which needs 1 slots
2013-10-31 16:06:36,213 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:06:36,214 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:06:36,215 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000002_0 which needs 1 slots
2013-10-31 16:06:36,217 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000002_0 which needs 1 slots
2013-10-31 16:06:36,217 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000003_0 which needs 1 slots
2013-10-31 16:06:36,218 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0004_m_000003_0 which needs 1 slots
2013-10-31 16:06:36,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken dst=null perm=null
2013-10-31 16:06:36,228 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54001, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7011938532533120784_1050, duration: 347479
2013-10-31 16:06:36,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml dst=null perm=null
2013-10-31 16:06:36,242 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47000, bytes: 28598, op: HDFS_READ, cliID: DFSClient_-1135888677, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5693872128215026843_1047, duration: 487751
2013-10-31 16:06:36,256 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-389116012
2013-10-31 16:06:36,256 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-389116012 spawned.
2013-10-31 16:06:36,257 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0004/attempt_20131031160444934_0004_m_000001_0. Attempting to reuse: jvm_20131031160444934_0004_m_-1151283590
2013-10-31 16:06:36,259 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000000_0/taskjvm.sh
2013-10-31 16:06:36,278 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:36,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar dst=null perm=null
2013-10-31 16:06:36,319 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33899, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1135888677, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7721447327930509679_1044, duration: 2125627
2013-10-31 16:06:36,418 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-2130177320
2013-10-31 16:06:36,420 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-2130177320 spawned.
2013-10-31 16:06:36,420 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_-1475551417
2013-10-31 16:06:36,420 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_-1475551417 spawned.
2013-10-31 16:06:36,423 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000002_0/taskjvm.sh
2013-10-31 16:06:36,423 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000003_0/taskjvm.sh
2013-10-31 16:06:36,473 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0004_m_000004_0' to tip task_20131031160444934_0004_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:06:36,474 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0004_m_000004
2013-10-31 16:06:36,475 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:06:36,475 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000004_0 which needs 1 slots
2013-10-31 16:06:36,476 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000004_0 which needs 1 slots
2013-10-31 16:06:36,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004/jobToken dst=null perm=null
2013-10-31 16:06:36,484 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54005, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7011938532533120784_1050, duration: 158719
2013-10-31 16:06:36,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.xml dst=null perm=null
2013-10-31 16:06:36,494 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33902, bytes: 28598, op: HDFS_READ, cliID: DFSClient_1208501720, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5693872128215026843_1047, duration: 209943
2013-10-31 16:06:36,523 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:36,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.jar dst=null perm=null
2013-10-31 16:06:36,561 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47005, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1208501720, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7721447327930509679_1044, duration: 2009608
2013-10-31 16:06:36,671 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0004_m_2107520939
2013-10-31 16:06:36,671 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0004_m_2107520939 spawned.
2013-10-31 16:06:36,673 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0004/attempt_20131031160444934_0004_m_000004_0/taskjvm.sh
2013-10-31 16:06:36,699 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1151283590 given task: attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:36,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=null
2013-10-31 16:06:36,820 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33974, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 197739
2013-10-31 16:06:36,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:36,862 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47008, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 305856
2013-10-31 16:06:36,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:36,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:37,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:37,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:37,121 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47009, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 134891
2013-10-31 16:06:37,129 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001. blk_1449395719476858224_1051
2013-10-31 16:06:37,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1449395719476858224_1051 src: /127.0.0.1:54013 dest: /127.0.0.1:41648
2013-10-31 16:06:37,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1449395719476858224_1051 src: /127.0.0.1:33978 dest: /127.0.0.1:38271
2013-10-31 16:06:37,158 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1449395719476858224_1051 src: /127.0.0.1:33910 dest: /127.0.0.1:50942
2013-10-31 16:06:37,161 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33910, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1449395719476858224_1051, duration: 1618659
2013-10-31 16:06:37,162 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1449395719476858224_1051 terminating
2013-10-31 16:06:37,162 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33978, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1449395719476858224_1051, duration: 2030816
2013-10-31 16:06:37,163 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1449395719476858224_1051 terminating
2013-10-31 16:06:37,163 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54013, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 2975967
2013-10-31 16:06:37,163 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1449395719476858224_1051 terminating
2013-10-31 16:06:37,163 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1449395719476858224_1051 size 8
2013-10-31 16:06:37,164 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1449395719476858224_1051 size 8
2013-10-31 16:06:37,166 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1449395719476858224_1051 size 8
2013-10-31 16:06:37,167 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:37,167 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:37,216 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:37,216 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000001_0 0.0%
2013-10-31 16:06:38,239 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-389116012 given task: attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:38,259 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3600945390313710710_1002
2013-10-31 16:06:38,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=null
2013-10-31 16:06:38,735 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33985, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 259960
2013-10-31 16:06:38,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:38,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:38,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:38,797 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1475551417 given task: attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:38,800 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_2107520939 given task: attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:38,807 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-2130177320 given task: attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:39,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,006 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47019, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 172782
2013-10-31 16:06:39,010 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33918, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 136852
2013-10-31 16:06:39,018 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000. blk_-7357275626124955184_1052
2013-10-31 16:06:39,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7357275626124955184_1052 src: /127.0.0.1:33988 dest: /127.0.0.1:38271
2013-10-31 16:06:39,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7357275626124955184_1052 src: /127.0.0.1:54025 dest: /127.0.0.1:41648
2013-10-31 16:06:39,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7357275626124955184_1052 src: /127.0.0.1:47023 dest: /127.0.0.1:47311
2013-10-31 16:06:39,047 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47023, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7357275626124955184_1052, duration: 1670712
2013-10-31 16:06:39,047 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7357275626124955184_1052 terminating
2013-10-31 16:06:39,047 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54025, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 1904524
2013-10-31 16:06:39,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7357275626124955184_1052 terminating
2013-10-31 16:06:39,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33988, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7357275626124955184_1052, duration: 2367853
2013-10-31 16:06:39,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7357275626124955184_1052 terminating
2013-10-31 16:06:39,048 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7357275626124955184_1052 size 8
2013-10-31 16:06:39,049 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:39,049 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:39,049 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7357275626124955184_1052 size 8
2013-10-31 16:06:39,050 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7357275626124955184_1052 size 8
2013-10-31 16:06:39,213 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000001_0
2013-10-31 16:06:39,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0 dst=null perm=null
2013-10-31 16:06:39,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000001_0 dst=null perm=null
2013-10-31 16:06:39,330 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:39,330 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000000_0 0.0%
2013-10-31 16:06:39,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=null
2013-10-31 16:06:39,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=null
2013-10-31 16:06:39,428 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33924, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4985515153484692347_1045, duration: 196590
2013-10-31 16:06:39,429 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54030, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4985515153484692347_1045, duration: 179595
2013-10-31 16:06:39,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:39,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:39,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47029, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 135739
2013-10-31 16:06:39,468 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33997, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 129766
2013-10-31 16:06:39,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004/job.split dst=null perm=null
2013-10-31 16:06:39,515 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:33998, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4985515153484692347_1045, duration: 207379
2013-10-31 16:06:39,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:39,555 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47032, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 146989
2013-10-31 16:06:39,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:39,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:39,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,696 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33931, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 148377
2013-10-31 16:06:39,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,706 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003. blk_-3591799862562816615_1055
2013-10-31 16:06:39,708 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33933, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 123828
2013-10-31 16:06:39,717 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004. blk_-8669963822589499838_1055
2013-10-31 16:06:39,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3591799862562816615_1055 src: /127.0.0.1:54037 dest: /127.0.0.1:41648
2013-10-31 16:06:39,729 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3591799862562816615_1055 src: /127.0.0.1:34004 dest: /127.0.0.1:38271
2013-10-31 16:06:39,730 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3591799862562816615_1055 src: /127.0.0.1:33936 dest: /127.0.0.1:50942
2013-10-31 16:06:39,733 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33936, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3591799862562816615_1055, duration: 1446199
2013-10-31 16:06:39,734 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3591799862562816615_1055 terminating
2013-10-31 16:06:39,734 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34004, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3591799862562816615_1055, duration: 2600645
2013-10-31 16:06:39,734 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3591799862562816615_1055 terminating
2013-10-31 16:06:39,734 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54037, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3591799862562816615_1055, duration: 3001074
2013-10-31 16:06:39,735 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3591799862562816615_1055 terminating
2013-10-31 16:06:39,736 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3591799862562816615_1055 size 8
2013-10-31 16:06:39,737 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3591799862562816615_1055 size 8
2013-10-31 16:06:39,737 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3591799862562816615_1055 size 8
2013-10-31 16:06:39,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8669963822589499838_1055 src: /127.0.0.1:54039 dest: /127.0.0.1:41648
2013-10-31 16:06:39,742 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8669963822589499838_1055 src: /127.0.0.1:33937 dest: /127.0.0.1:50942
2013-10-31 16:06:39,742 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8669963822589499838_1055 src: /127.0.0.1:34007 dest: /127.0.0.1:38271
2013-10-31 16:06:39,744 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34007, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8669963822589499838_1055, duration: 1098631
2013-10-31 16:06:39,744 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8669963822589499838_1055 terminating
2013-10-31 16:06:39,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33937, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8669963822589499838_1055, duration: 1689512
2013-10-31 16:06:39,745 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8669963822589499838_1055 terminating
2013-10-31 16:06:39,745 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8669963822589499838_1055 size 8
2013-10-31 16:06:39,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54039, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8669963822589499838_1055, duration: 2012976
2013-10-31 16:06:39,745 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8669963822589499838_1055 size 8
2013-10-31 16:06:39,745 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8669963822589499838_1055 terminating
2013-10-31 16:06:39,746 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:39,746 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:39,748 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8669963822589499838_1055 size 8
2013-10-31 16:06:39,780 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:06:39,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,780 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000001_0 is done.
2013-10-31 16:06:39,781 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000001_0 was -1
2013-10-31 16:06:39,781 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:39,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:39,786 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33939, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 141331
2013-10-31 16:06:39,792 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:39,793 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000004_0 0.0%
2013-10-31 16:06:39,796 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002. blk_-3081719028497960391_1055
2013-10-31 16:06:39,819 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3081719028497960391_1055 src: /127.0.0.1:47042 dest: /127.0.0.1:47311
2013-10-31 16:06:39,821 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3081719028497960391_1055 src: /127.0.0.1:33941 dest: /127.0.0.1:50942
2013-10-31 16:06:39,822 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3081719028497960391_1055 src: /127.0.0.1:54047 dest: /127.0.0.1:41648
2013-10-31 16:06:39,825 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54047, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3081719028497960391_1055, duration: 1536233
2013-10-31 16:06:39,825 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3081719028497960391_1055 terminating
2013-10-31 16:06:39,826 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33941, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3081719028497960391_1055, duration: 1721653
2013-10-31 16:06:39,826 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3081719028497960391_1055 terminating
2013-10-31 16:06:39,826 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47042, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0004_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3081719028497960391_1055, duration: 2675142
2013-10-31 16:06:39,827 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3081719028497960391_1055 terminating
2013-10-31 16:06:39,828 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3081719028497960391_1055 size 8
2013-10-31 16:06:39,829 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:39,829 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:39,829 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3081719028497960391_1055 size 8
2013-10-31 16:06:39,830 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3081719028497960391_1055 size 8
2013-10-31 16:06:39,849 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:06:39,856 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,867 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,879 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:39,879 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000002_0 0.0%
2013-10-31 16:06:39,880 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:06:39,886 INFO metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:06:40,137 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:40,138 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:40,192 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0004_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:06:40,193 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000003_0 0.0%
2013-10-31 16:06:41,210 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0004_m_000006_0
2013-10-31 16:06:41,211 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0004_m_000006_0
2013-10-31 16:06:41,211 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000006_0 not found in cache
2013-10-31 16:06:42,217 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000001_0' has completed task_20131031160444934_0004_m_000001 successfully.
2013-10-31 16:06:42,219 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000000_0
2013-10-31 16:06:42,220 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000002_0
2013-10-31 16:06:42,221 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000003_0
2013-10-31 16:06:42,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0 dst=null perm=null
2013-10-31 16:06:42,349 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 300 Total time for transactions(ms): 8Number of transactions batched in Syncs: 32 Number of syncs: 206 SyncTimes(ms): 9432 882
2013-10-31 16:06:42,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:42,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:42,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000000_0 dst=null perm=null
2013-10-31 16:06:42,481 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0004_m_000004_0
2013-10-31 16:06:42,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0 dst=null perm=null
2013-10-31 16:06:42,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:42,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:42,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000004_0 dst=null perm=null
2013-10-31 16:06:42,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0 dst=null perm=null
2013-10-31 16:06:42,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:43,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:43,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000002_0 dst=null perm=null
2013-10-31 16:06:43,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0 dst=null perm=null
2013-10-31 16:06:43,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:43,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:43,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary/_attempt_20131031160444934_0004_m_000003_0 dst=null perm=null
2013-10-31 16:06:44,710 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:06:44,712 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:06:44,713 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000000_0 is done.
2013-10-31 16:06:44,713 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000000_0 was -1
2013-10-31 16:06:44,713 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:45,223 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000000_0' has completed task_20131031160444934_0004_m_000000 successfully.
2013-10-31 16:06:45,393 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:06:45,395 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:06:45,395 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000003_0 is done.
2013-10-31 16:06:45,396 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000003_0 was -1
2013-10-31 16:06:45,396 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:06:45,408 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:06:45,410 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:06:45,411 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000004_0 is done.
2013-10-31 16:06:45,411 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000004_0 was -1
2013-10-31 16:06:45,411 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:45,478 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:06:45,482 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:06:45,483 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000002_0 is done.
2013-10-31 16:06:45,484 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000002_0 was -1
2013-10-31 16:06:45,484 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:45,485 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000004_0' has completed task_20131031160444934_0004_m_000004 successfully.
2013-10-31 16:06:48,230 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000002_0' has completed task_20131031160444934_0004_m_000002 successfully.
2013-10-31 16:06:48,255 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000003_0' has completed task_20131031160444934_0004_m_000003 successfully.
2013-10-31 16:06:48,260 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0004_m_000005_0' to tip task_20131031160444934_0004_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:48,262 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0004_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:06:48,262 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0004_m_000005_0 which needs 1 slots
2013-10-31 16:06:48,263 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0004_m_000005_0 which needs 1 slots
2013-10-31 16:06:48,298 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0004/attempt_20131031160444934_0004_m_000005_0. Attempting to reuse: jvm_20131031160444934_0004_m_-1475551417
2013-10-31 16:06:48,945 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0004_m_-1475551417 given task: attempt_20131031160444934_0004_m_000005_0
2013-10-31 16:06:49,038 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000005_0 0.0%
2013-10-31 16:06:49,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary dst=null perm=null
2013-10-31 16:06:49,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:49,055 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_SUCCESS from client DFSClient_attempt_20131031160444934_0004_m_000005_0
2013-10-31 16:06:49,055 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0004_m_000005_0
2013-10-31 16:06:49,061 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:49,061 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,062 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,062 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7721447327930509679 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:49,062 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:49,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:49,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4985515153484692347 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2374554834453302461 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2374554834453302461 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:06:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2374554834453302461 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,065 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5693872128215026843 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:49,065 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5693872128215026843 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:49,066 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5693872128215026843 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:49,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0004 dst=null perm=null
2013-10-31 16:06:51,167 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-2374554834453302461_1046 blk_-5693872128215026843_1047 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:51,168 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-2374554834453302461_1046 blk_-5693872128215026843_1047 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:51,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5693872128215026843_1047 file build/test/data/dfs/data/data4/current/blk_-5693872128215026843 for deletion
2013-10-31 16:06:51,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2374554834453302461_1046 file build/test/data/dfs/data/data3/current/blk_-2374554834453302461 for deletion
2013-10-31 16:06:51,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5693872128215026843_1047 at file build/test/data/dfs/data/data4/current/blk_-5693872128215026843
2013-10-31 16:06:51,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data4/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:51,267 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2374554834453302461_1046 at file build/test/data/dfs/data/data3/current/blk_-2374554834453302461
2013-10-31 16:06:51,267 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data3/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:51,267 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data4/current/blk_4985515153484692347
2013-10-31 16:06:51,268 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data3/current/blk_7721447327930509679
2013-10-31 16:06:52,012 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0004_m_000005_0 0.0% cleanup
2013-10-31 16:06:52,013 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0004_m_000005_0 is done.
2013-10-31 16:06:52,014 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0004_m_000005_0 was -1
2013-10-31 16:06:52,014 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:06:53,868 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5693872128215026843_1047 file build/test/data/dfs/data/data8/current/blk_-5693872128215026843 for deletion
2013-10-31 16:06:53,868 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2374554834453302461_1046 file build/test/data/dfs/data/data7/current/blk_-2374554834453302461 for deletion
2013-10-31 16:06:53,868 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5693872128215026843_1047 at file build/test/data/dfs/data/data8/current/blk_-5693872128215026843
2013-10-31 16:06:53,869 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data8/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:53,869 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2374554834453302461_1046 at file build/test/data/dfs/data/data7/current/blk_-2374554834453302461
2013-10-31 16:06:53,869 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data8/current/blk_4985515153484692347
2013-10-31 16:06:53,869 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data7/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:53,870 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data7/current/blk_7721447327930509679
2013-10-31 16:06:54,168 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-5693872128215026843_1047 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:54,168 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-2374554834453302461_1046 blk_7721447327930509679_1044 blk_4985515153484692347_1045
2013-10-31 16:06:54,271 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0004_m_000005_0' has completed task_20131031160444934_0004_m_000005 successfully.
2013-10-31 16:06:54,272 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0004 has completed successfully.
2013-10-31 16:06:54,272 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0004,submitTime=1383235588508,launchTime=1383235588648,firstMapTaskLaunchTime=1383235596203,firstJobSetupTaskLaunchTime=1383235590186,firstJobCleanupTaskLaunchTime=1383235608259,finishTime=1383235614272,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C301A18D6809482D9C99B3DF7ED74D6F/01A575840C0E48F08DD429208D422466] tail/(1/1) ...ipesplatform/renamedpipes
2013-10-31 16:06:54,279 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0. blk_3549128818189452633_1056
2013-10-31 16:06:54,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3549128818189452633_1056 src: /127.0.0.1:54050 dest: /127.0.0.1:41648
2013-10-31 16:06:54,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3549128818189452633_1056 src: /127.0.0.1:33946 dest: /127.0.0.1:50942
2013-10-31 16:06:54,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3549128818189452633_1056 src: /127.0.0.1:34016 dest: /127.0.0.1:38271
2013-10-31 16:06:54,296 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34016, dest: /127.0.0.1:38271, bytes: 26330, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3549128818189452633_1056, duration: 6512926
2013-10-31 16:06:54,296 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3549128818189452633_1056 terminating
2013-10-31 16:06:54,297 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33946, dest: /127.0.0.1:50942, bytes: 26330, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3549128818189452633_1056, duration: 8869846
2013-10-31 16:06:54,297 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3549128818189452633_1056 terminating
2013-10-31 16:06:54,298 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54050, dest: /127.0.0.1:41648, bytes: 26330, op: HDFS_WRITE, cliID: DFSClient_1479709366, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3549128818189452633_1056, duration: 6808679
2013-10-31 16:06:54,299 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3549128818189452633_1056 size 26330
2013-10-31 16:06:54,299 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3549128818189452633_1056 terminating
2013-10-31 16:06:54,303 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3549128818189452633_1056 size 26330
2013-10-31 16:06:54,307 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0 from client DFSClient_1479709366
2013-10-31 16:06:54,308 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_logs/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0 is closed by DFSClient_1479709366
2013-10-31 16:06:54,308 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3549128818189452633_1056 size 26330
2013-10-31 16:06:54,314 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0004_1383235588508_hadoop_%5BC301A18D6809482D9C99B3DF7ED74D6F%2F01A575840C0E48F0 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:54,316 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000002_0'
2013-10-31 16:06:54,316 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000003_0'
2013-10-31 16:06:54,316 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000005_0'
2013-10-31 16:06:54,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7011938532533120784 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:06:54,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7011938532533120784 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:06:54,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7011938532533120784 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:06:54,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0004 dst=null perm=null
2013-10-31 16:06:54,323 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0004_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:06:54,326 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/_temporary
2013-10-31 16:06:54,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2013-10-31 16:06:54,350 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:54,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2013-10-31 16:06:54,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2013-10-31 16:06:54,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2013-10-31 16:06:54,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2013-10-31 16:06:54,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2013-10-31 16:06:54,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2013-10-31 16:06:54,355 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54054, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 143043
2013-10-31 16:06:54,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2013-10-31 16:06:54,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54055, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 152519
2013-10-31 16:06:54,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2013-10-31 16:06:54,358 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33951, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3081719028497960391_1055, duration: 133063
2013-10-31 16:06:54,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2013-10-31 16:06:54,359 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54057, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3591799862562816615_1055, duration: 132880
2013-10-31 16:06:54,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2013-10-31 16:06:54,360 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54058, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8669963822589499838_1055, duration: 131564
2013-10-31 16:06:54,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2013-10-31 16:06:54,369 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:06:54,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2013-10-31 16:06:54,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2013-10-31 16:06:54,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2013-10-31 16:06:54,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2013-10-31 16:06:54,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2013-10-31 16:06:54,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2013-10-31 16:06:54,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54059, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 129060
2013-10-31 16:06:54,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2013-10-31 16:06:54,375 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54060, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 124967
2013-10-31 16:06:54,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2013-10-31 16:06:54,376 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54061, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3081719028497960391_1055, duration: 123299
2013-10-31 16:06:54,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2013-10-31 16:06:54,378 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34026, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3591799862562816615_1055, duration: 122990
2013-10-31 16:06:54,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2013-10-31 16:06:54,379 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34027, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8669963822589499838_1055, duration: 126178
2013-10-31 16:06:54,379 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/renamedpipes
2013-10-31 16:06:54,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2013-10-31 16:06:54,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2013-10-31 16:06:54,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54064, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7357275626124955184_1052, duration: 139970
2013-10-31 16:06:54,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2013-10-31 16:06:54,385 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54065, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1449395719476858224_1051, duration: 128887
2013-10-31 16:06:54,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2013-10-31 16:06:54,387 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47063, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3081719028497960391_1055, duration: 150829
2013-10-31 16:06:54,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2013-10-31 16:06:54,389 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34031, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3591799862562816615_1055, duration: 121875
2013-10-31 16:06:54,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2013-10-31 16:06:54,393 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33963, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8669963822589499838_1055, duration: 224181
2013-10-31 16:06:54,412 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:06:54,412 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:06:54,449 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:06:54,449 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:06:54,449 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:06:54,450 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery"]
2013-10-31 16:06:54,451 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:06:54,451 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 3
2013-10-31 16:06:54,451 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 3
2013-10-31 16:06:54,453 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/3)
2013-10-31 16:06:54,454 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/3)
2013-10-31 16:06:54,460 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:54,460 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:06:54,463 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:06:54,463 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:06:54,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:54,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:06:54,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:54,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:06:54,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:54,494 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar. blk_-8532132085552426957_1057
2013-10-31 16:06:54,496 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000004_0'
2013-10-31 16:06:54,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:54069 dest: /127.0.0.1:41648
2013-10-31 16:06:54,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:34034 dest: /127.0.0.1:38271
2013-10-31 16:06:54,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:47068 dest: /127.0.0.1:47311
2013-10-31 16:06:54,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:54,505 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar. blk_6795492832038410935_1058
2013-10-31 16:06:54,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:54072 dest: /127.0.0.1:41648
2013-10-31 16:06:54,509 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47068, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8532132085552426957_1057, duration: 4475447
2013-10-31 16:06:54,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:33968 dest: /127.0.0.1:50942
2013-10-31 16:06:54,509 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8532132085552426957_1057 terminating
2013-10-31 16:06:54,510 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:54,510 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34034, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8532132085552426957_1057, duration: 5345547
2013-10-31 16:06:54,511 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8532132085552426957_1057 terminating
2013-10-31 16:06:54,511 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54069, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8532132085552426957_1057, duration: 6609377
2013-10-31 16:06:54,511 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:47071 dest: /127.0.0.1:47311
2013-10-31 16:06:54,512 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8532132085552426957_1057 terminating
2013-10-31 16:06:54,513 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:54,514 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar from client DFSClient_1457307213
2013-10-31 16:06:54,517 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:54,517 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:54,526 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar. New replication is 10
2013-10-31 16:06:54,528 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47071, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 10533753
2013-10-31 16:06:54,528 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6795492832038410935_1058 terminating
2013-10-31 16:06:54,529 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33968, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6795492832038410935_1058, duration: 11694864
2013-10-31 16:06:54,529 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6795492832038410935_1058 terminating
2013-10-31 16:06:54,529 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54072, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6795492832038410935_1058, duration: 12246990
2013-10-31 16:06:54,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar dst=null perm=null
2013-10-31 16:06:54,530 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6795492832038410935_1058 terminating
2013-10-31 16:06:54,533 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:54,533 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar from client DFSClient_1457307213
2013-10-31 16:06:54,534 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar is closed by DFSClient_1457307213
2013-10-31 16:06:54,534 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:54,534 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:54,579 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar. New replication is 10
2013-10-31 16:06:54,879 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5693872128215026843_1047 file build/test/data/dfs/data/data5/current/blk_-5693872128215026843 for deletion
2013-10-31 16:06:54,879 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data6/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:54,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5693872128215026843_1047 at file build/test/data/dfs/data/data5/current/blk_-5693872128215026843
2013-10-31 16:06:54,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data6/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:54,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data6/current/blk_4985515153484692347
2013-10-31 16:06:54,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data6/current/blk_7721447327930509679
2013-10-31 16:06:55,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,176 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:55,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar dst=null perm=null
2013-10-31 16:06:55,183 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:55,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:06:55,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,188 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:06:55,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,194 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:06:55,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:06:55,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,200 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split. New replication is 10
2013-10-31 16:06:55,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=null
2013-10-31 16:06:55,212 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split. blk_-6361285198433998341_1060
2013-10-31 16:06:55,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:47073 dest: /127.0.0.1:47311
2013-10-31 16:06:55,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:33972 dest: /127.0.0.1:50942
2013-10-31 16:06:55,217 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:34042 dest: /127.0.0.1:38271
2013-10-31 16:06:55,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6361285198433998341_1060 src: /127.0.0.1:54079 dest: /127.0.0.1:41648
2013-10-31 16:06:55,222 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54079, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 92486
2013-10-31 16:06:55,223 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,223 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34042, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6361285198433998341_1060, duration: 945435
2013-10-31 16:06:55,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33972, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6361285198433998341_1060, duration: 1862523
2013-10-31 16:06:55,224 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47073, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6361285198433998341_1060, duration: 2741700
2013-10-31 16:06:55,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6361285198433998341_1060 terminating
2013-10-31 16:06:55,227 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,227 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split from client DFSClient_1457307213
2013-10-31 16:06:55,228 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:55,228 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split. New replication is 10
2013-10-31 16:06:55,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,230 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6361285198433998341_1060 size 1732
2013-10-31 16:06:55,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=null
2013-10-31 16:06:55,240 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split. blk_5739859526044531261_1061
2013-10-31 16:06:55,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,243 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:54080 dest: /127.0.0.1:41648
2013-10-31 16:06:55,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:47078 dest: /127.0.0.1:47311
2013-10-31 16:06:55,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:34046 dest: /127.0.0.1:38271
2013-10-31 16:06:55,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5739859526044531261_1061 src: /127.0.0.1:33978 dest: /127.0.0.1:50942
2013-10-31 16:06:55,251 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33978, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5739859526044531261_1061, duration: 89378
2013-10-31 16:06:55,252 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,252 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34046, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 891264
2013-10-31 16:06:55,253 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,253 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47078, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5739859526044531261_1061, duration: 1848442
2013-10-31 16:06:55,253 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,254 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,254 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54080, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5739859526044531261_1061, duration: 2955114
2013-10-31 16:06:55,254 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5739859526044531261_1061 terminating
2013-10-31 16:06:55,260 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,260 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split from client DFSClient_1457307213
2013-10-31 16:06:55,260 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split is closed by DFSClient_1457307213
2013-10-31 16:06:55,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5739859526044531261_1061 size 1732
2013-10-31 16:06:55,263 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:06:55,264 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0004 being deleted.
2013-10-31 16:06:55,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,273 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo. blk_4742838560224575816_1062
2013-10-31 16:06:55,275 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4742838560224575816_1062 src: /127.0.0.1:33979 dest: /127.0.0.1:50942
2013-10-31 16:06:55,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4742838560224575816_1062 src: /127.0.0.1:47082 dest: /127.0.0.1:47311
2013-10-31 16:06:55,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4742838560224575816_1062 src: /127.0.0.1:34050 dest: /127.0.0.1:38271
2013-10-31 16:06:55,281 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34050, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4742838560224575816_1062, duration: 72558
2013-10-31 16:06:55,281 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4742838560224575816_1062 terminating
2013-10-31 16:06:55,282 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47082, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4742838560224575816_1062, duration: 903191
2013-10-31 16:06:55,282 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4742838560224575816_1062 terminating
2013-10-31 16:06:55,283 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4742838560224575816_1062 size 183
2013-10-31 16:06:55,283 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33979, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4742838560224575816_1062, duration: 1708273
2013-10-31 16:06:55,283 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4742838560224575816_1062 terminating
2013-10-31 16:06:55,285 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4742838560224575816_1062 size 183
2013-10-31 16:06:55,286 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:55,286 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:55,287 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4742838560224575816_1062 size 183
2013-10-31 16:06:55,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,298 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo. blk_-5582207694431061275_1063
2013-10-31 16:06:55,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5582207694431061275_1063 src: /127.0.0.1:34051 dest: /127.0.0.1:38271
2013-10-31 16:06:55,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,302 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5582207694431061275_1063 src: /127.0.0.1:33983 dest: /127.0.0.1:50942
2013-10-31 16:06:55,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5582207694431061275_1063 src: /127.0.0.1:47086 dest: /127.0.0.1:47311
2013-10-31 16:06:55,306 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47086, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5582207694431061275_1063, duration: 65716
2013-10-31 16:06:55,307 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5582207694431061275_1063 terminating
2013-10-31 16:06:55,307 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33983, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5582207694431061275_1063, duration: 1003375
2013-10-31 16:06:55,308 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5582207694431061275_1063 terminating
2013-10-31 16:06:55,308 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5582207694431061275_1063 size 183
2013-10-31 16:06:55,308 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34051, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5582207694431061275_1063, duration: 1812414
2013-10-31 16:06:55,309 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5582207694431061275_1063 terminating
2013-10-31 16:06:55,313 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5582207694431061275_1063 size 183
2013-10-31 16:06:55,314 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:06:55,314 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:06:55,316 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5582207694431061275_1063 size 183
2013-10-31 16:06:55,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,331 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml. blk_3866472487802171399_1064
2013-10-31 16:06:55,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866472487802171399_1064 src: /127.0.0.1:34054 dest: /127.0.0.1:38271
2013-10-31 16:06:55,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866472487802171399_1064 src: /127.0.0.1:33986 dest: /127.0.0.1:50942
2013-10-31 16:06:55,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3866472487802171399_1064 src: /127.0.0.1:54092 dest: /127.0.0.1:41648
2013-10-31 16:06:55,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,340 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54092, dest: /127.0.0.1:41648, bytes: 28245, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3866472487802171399_1064, duration: 224320
2013-10-31 16:06:55,340 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3866472487802171399_1064 terminating
2013-10-31 16:06:55,341 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33986, dest: /127.0.0.1:50942, bytes: 28245, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 1034977
2013-10-31 16:06:55,341 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3866472487802171399_1064 terminating
2013-10-31 16:06:55,342 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34054, dest: /127.0.0.1:38271, bytes: 28245, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3866472487802171399_1064, duration: 1926582
2013-10-31 16:06:55,342 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3866472487802171399_1064 terminating
2013-10-31 16:06:55,344 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3866472487802171399_1064 size 28245
2013-10-31 16:06:55,344 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml from client DFSClient_1457307213
2013-10-31 16:06:55,345 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:55,345 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3866472487802171399_1064 size 28245
2013-10-31 16:06:55,346 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3866472487802171399_1064 size 28245
2013-10-31 16:06:55,350 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml. blk_-5721256196737463602_1064
2013-10-31 16:06:55,352 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5721256196737463602_1064 src: /127.0.0.1:47090 dest: /127.0.0.1:47311
2013-10-31 16:06:55,354 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5721256196737463602_1064 src: /127.0.0.1:34058 dest: /127.0.0.1:38271
2013-10-31 16:06:55,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5721256196737463602_1064 src: /127.0.0.1:33990 dest: /127.0.0.1:50942
2013-10-31 16:06:55,358 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33990, dest: /127.0.0.1:50942, bytes: 28237, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5721256196737463602_1064, duration: 214452
2013-10-31 16:06:55,359 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5721256196737463602_1064 terminating
2013-10-31 16:06:55,359 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34058, dest: /127.0.0.1:38271, bytes: 28237, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5721256196737463602_1064, duration: 1143355
2013-10-31 16:06:55,360 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5721256196737463602_1064 terminating
2013-10-31 16:06:55,360 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47090, dest: /127.0.0.1:47311, bytes: 28237, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5721256196737463602_1064, duration: 2003250
2013-10-31 16:06:55,360 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5721256196737463602_1064 terminating
2013-10-31 16:06:55,361 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5721256196737463602_1064 size 28237
2013-10-31 16:06:55,362 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5721256196737463602_1064 size 28237
2013-10-31 16:06:55,363 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml from client DFSClient_1457307213
2013-10-31 16:06:55,363 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml is closed by DFSClient_1457307213
2013-10-31 16:06:55,363 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5721256196737463602_1064 size 28237
2013-10-31 16:06:55,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml dst=null perm=null
2013-10-31 16:06:55,723 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:33992, bytes: 28469, op: HDFS_READ, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 573505
2013-10-31 16:06:55,743 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0005: nMaps=5 nReduces=1 max=-1
2013-10-31 16:06:55,743 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0005 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:55,743 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0005
2013-10-31 16:06:55,743 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0005 RESULT=SUCCESS
2013-10-31 16:06:55,744 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0005
2013-10-31 16:06:55,746 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0005
2013-10-31 16:06:55,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml dst=null perm=null
2013-10-31 16:06:55,755 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47096, bytes: 28461, op: HDFS_READ, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5721256196737463602_1064, duration: 531928
2013-10-31 16:06:55,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,763 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0006: nMaps=5 nReduces=1 max=-1
2013-10-31 16:06:55,763 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0006 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:06:55,763 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0006 RESULT=SUCCESS
2013-10-31 16:06:55,763 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0006
2013-10-31 16:06:55,764 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0006
2013-10-31 16:06:55,765 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0006
2013-10-31 16:06:55,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,784 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml. blk_7203448194588732562_1068
2013-10-31 16:06:55,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:55,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7203448194588732562_1068 src: /127.0.0.1:33995 dest: /127.0.0.1:50942
2013-10-31 16:06:55,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7203448194588732562_1068 src: /127.0.0.1:47098 dest: /127.0.0.1:47311
2013-10-31 16:06:55,788 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml. blk_6149960951356387480_1068
2013-10-31 16:06:55,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7203448194588732562_1068 src: /127.0.0.1:54102 dest: /127.0.0.1:41648
2013-10-31 16:06:55,791 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6149960951356387480_1068 src: /127.0.0.1:47100 dest: /127.0.0.1:47311
2013-10-31 16:06:55,792 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54102, dest: /127.0.0.1:41648, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7203448194588732562_1068, duration: 941377
2013-10-31 16:06:55,792 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6149960951356387480_1068 src: /127.0.0.1:34068 dest: /127.0.0.1:38271
2013-10-31 16:06:55,792 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7203448194588732562_1068 terminating
2013-10-31 16:06:55,792 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47098, dest: /127.0.0.1:47311, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7203448194588732562_1068, duration: 1348107
2013-10-31 16:06:55,793 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7203448194588732562_1068 terminating
2013-10-31 16:06:55,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:33995, dest: /127.0.0.1:50942, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7203448194588732562_1068, duration: 2245887
2013-10-31 16:06:55,793 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7203448194588732562_1068 terminating
2013-10-31 16:06:55,794 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6149960951356387480_1068 src: /127.0.0.1:54105 dest: /127.0.0.1:41648
2013-10-31 16:06:55,797 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7203448194588732562_1068 size 28310
2013-10-31 16:06:55,797 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7203448194588732562_1068 size 28310
2013-10-31 16:06:55,798 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7203448194588732562_1068 size 28310
2013-10-31 16:06:55,798 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54105, dest: /127.0.0.1:41648, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6149960951356387480_1068, duration: 1908372
2013-10-31 16:06:55,798 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6149960951356387480_1068 terminating
2013-10-31 16:06:55,798 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34068, dest: /127.0.0.1:38271, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6149960951356387480_1068, duration: 902075
2013-10-31 16:06:55,799 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6149960951356387480_1068 terminating
2013-10-31 16:06:55,799 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47100, dest: /127.0.0.1:47311, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6149960951356387480_1068, duration: 3095961
2013-10-31 16:06:55,799 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6149960951356387480_1068 terminating
2013-10-31 16:06:55,801 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6149960951356387480_1068 size 28302
2013-10-31 16:06:55,802 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6149960951356387480_1068 size 28302
2013-10-31 16:06:55,803 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6149960951356387480_1068 size 28302
2013-10-31 16:06:56,196 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml from client DFSClient_-63336241
2013-10-31 16:06:56,197 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_conf.xml is closed by DFSClient_-63336241
2013-10-31 16:06:56,202 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml from client DFSClient_898051513
2013-10-31 16:06:56,202 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_conf.xml is closed by DFSClient_898051513
2013-10-31 16:06:56,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:56,218 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken. blk_604723262076837153_1070
2013-10-31 16:06:56,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_604723262076837153_1070 src: /127.0.0.1:47103 dest: /127.0.0.1:47311
2013-10-31 16:06:56,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:06:56,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_604723262076837153_1070 src: /127.0.0.1:34002 dest: /127.0.0.1:50942
2013-10-31 16:06:56,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_604723262076837153_1070 src: /127.0.0.1:54108 dest: /127.0.0.1:41648
2013-10-31 16:06:56,276 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54108, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_604723262076837153_1070, duration: 402895
2013-10-31 16:06:56,276 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_604723262076837153_1070 terminating
2013-10-31 16:06:56,276 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_604723262076837153_1070 size 116
2013-10-31 16:06:56,277 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34002, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_604723262076837153_1070, duration: 2510016
2013-10-31 16:06:56,277 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken. blk_1639395190201929201_1070
2013-10-31 16:06:56,277 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_604723262076837153_1070 terminating
2013-10-31 16:06:56,277 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47103, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_604723262076837153_1070, duration: 3035246
2013-10-31 16:06:56,278 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_604723262076837153_1070 terminating
2013-10-31 16:06:56,279 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken from client DFSClient_1457307213
2013-10-31 16:06:56,279 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:56,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1639395190201929201_1070 src: /127.0.0.1:34004 dest: /127.0.0.1:50942
2013-10-31 16:06:56,280 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1639395190201929201_1070 src: /127.0.0.1:34074 dest: /127.0.0.1:38271
2013-10-31 16:06:56,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1639395190201929201_1070 src: /127.0.0.1:54111 dest: /127.0.0.1:41648
2013-10-31 16:06:56,281 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_604723262076837153_1070 size 116
2013-10-31 16:06:56,281 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_604723262076837153_1070 size 116
2013-10-31 16:06:56,282 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54111, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1639395190201929201_1070, duration: 27172
2013-10-31 16:06:56,282 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1639395190201929201_1070 terminating
2013-10-31 16:06:56,282 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34074, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1639395190201929201_1070, duration: 378659
2013-10-31 16:06:56,283 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1639395190201929201_1070 terminating
2013-10-31 16:06:56,283 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken
2013-10-31 16:06:56,283 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34004, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1639395190201929201_1070, duration: 819815
2013-10-31 16:06:56,283 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1639395190201929201_1070 terminating
2013-10-31 16:06:56,284 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1639395190201929201_1070 size 116
2013-10-31 16:06:56,284 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken from client DFSClient_1457307213
2013-10-31 16:06:56,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.splitmetainfo dst=null perm=null
2013-10-31 16:06:56,285 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken is closed by DFSClient_1457307213
2013-10-31 16:06:56,285 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1639395190201929201_1070 size 116
2013-10-31 16:06:56,286 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34007, bytes: 187, op: HDFS_READ, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4742838560224575816_1062, duration: 141688
2013-10-31 16:06:56,286 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1639395190201929201_1070 size 116
2013-10-31 16:06:56,287 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0005 = 19. Number of splits = 5
2013-10-31 16:06:56,287 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,287 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,287 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0005_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,289 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0005 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:56,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.splitmetainfo dst=null perm=null
2013-10-31 16:06:56,289 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0005 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:06:56,290 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47110, bytes: 187, op: HDFS_READ, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5582207694431061275_1063, duration: 322533
2013-10-31 16:06:56,292 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0006 = 19. Number of splits = 5
2013-10-31 16:06:56,292 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,293 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,294 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,295 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0006_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:06:56,296 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0006 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:06:56,296 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0006 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:06:56,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2374554834453302461_1046 file build/test/data/dfs/data/data2/current/blk_-2374554834453302461 for deletion
2013-10-31 16:06:56,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4985515153484692347_1045 file build/test/data/dfs/data/data1/current/blk_4985515153484692347 for deletion
2013-10-31 16:06:56,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2374554834453302461_1046 at file build/test/data/dfs/data/data2/current/blk_-2374554834453302461
2013-10-31 16:06:56,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7721447327930509679_1044 file build/test/data/dfs/data/data2/current/blk_7721447327930509679 for deletion
2013-10-31 16:06:56,668 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4985515153484692347_1045 at file build/test/data/dfs/data/data1/current/blk_4985515153484692347
2013-10-31 16:06:56,668 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7721447327930509679_1044 at file build/test/data/dfs/data/data2/current/blk_7721447327930509679
2013-10-31 16:06:57,169 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-8532132085552426957_1057 to datanode(s) 127.0.0.1:50942
2013-10-31 16:06:57,170 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_6795492832038410935_1058 to datanode(s) 127.0.0.1:38271
2013-10-31 16:06:57,170 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_7011938532533120784_1050
2013-10-31 16:06:57,170 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_7011938532533120784_1050
2013-10-31 16:06:57,240 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0005_m_000006_0' to tip task_20131031160444934_0005_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:06:57,246 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000000_0'
2013-10-31 16:06:57,246 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000001_0'
2013-10-31 16:06:57,246 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0004_m_000006_0'
2013-10-31 16:06:57,248 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:57,248 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,248 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken dst=null perm=null
2013-10-31 16:06:57,259 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34009, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_604723262076837153_1070, duration: 350810
2013-10-31 16:06:57,267 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7011938532533120784_1050 file build/test/data/dfs/data/data3/current/blk_7011938532533120784 for deletion
2013-10-31 16:06:57,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml dst=null perm=null
2013-10-31 16:06:57,267 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7011938532533120784_1050 at file build/test/data/dfs/data/data3/current/blk_7011938532533120784
2013-10-31 16:06:57,272 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34011, bytes: 28469, op: HDFS_READ, cliID: DFSClient_-457764543, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 489355
2013-10-31 16:06:57,302 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:57,325 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0006_m_000006_0' to tip task_20131031160444934_0006_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:06:57,334 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:06:57,334 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,334 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000006_0 which needs 1 slots
2013-10-31 16:06:57,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken dst=null perm=null
2013-10-31 16:06:57,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34012, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1639395190201929201_1070, duration: 330234
2013-10-31 16:06:57,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar dst=null perm=null
2013-10-31 16:06:57,352 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47116, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-457764543, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8532132085552426957_1057, duration: 1172812
2013-10-31 16:06:57,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml dst=null perm=null
2013-10-31 16:06:57,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34015, bytes: 28461, op: HDFS_READ, cliID: DFSClient_1738221783, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5721256196737463602_1064, duration: 496972
2013-10-31 16:06:57,372 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:06:57,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar dst=null perm=null
2013-10-31 16:06:57,388 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47118, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1738221783, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 827545
2013-10-31 16:06:57,408 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0004_m_-1151283590
2013-10-31 16:06:57,413 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11777 with signal TERM. Exit code 0
2013-10-31 16:06:57,413 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-126897438
2013-10-31 16:06:57,414 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-126897438 spawned.
2013-10-31 16:06:57,415 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000006_0/taskjvm.sh
2013-10-31 16:06:57,445 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0004_m_-2130177320
2013-10-31 16:06:57,450 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12015 with signal TERM. Exit code 0
2013-10-31 16:06:57,450 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_1013282559
2013-10-31 16:06:57,450 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_1013282559 spawned.
2013-10-31 16:06:57,452 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000006_0/taskjvm.sh
2013-10-31 16:06:57,512 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:57,512 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:57,512 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:57,513 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-2130177320 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:06:57,880 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-8532132085552426957_1057 to 127.0.0.1:50942
2013-10-31 16:06:57,881 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_6795492832038410935_1058 to 127.0.0.1:38271
2013-10-31 16:06:57,881 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7011938532533120784_1050 file build/test/data/dfs/data/data5/current/blk_7011938532533120784 for deletion
2013-10-31 16:06:57,882 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7011938532533120784_1050 at file build/test/data/dfs/data/data5/current/blk_7011938532533120784
2013-10-31 16:06:57,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8532132085552426957_1057 src: /127.0.0.1:34017 dest: /127.0.0.1:50942
2013-10-31 16:06:57,883 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-8532132085552426957_1057 to /127.0.0.1:50942
2013-10-31 16:06:57,883 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_6795492832038410935_1058 to /127.0.0.1:38271
2013-10-31 16:06:57,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6795492832038410935_1058 src: /127.0.0.1:34086 dest: /127.0.0.1:38271
2013-10-31 16:06:57,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8532132085552426957_1057 src: /127.0.0.1:34017 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:06:57,889 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6795492832038410935_1058 src: /127.0.0.1:34086 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:06:57,890 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8532132085552426957_1057 size 238055
2013-10-31 16:06:57,892 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6795492832038410935_1058 size 238055
2013-10-31 16:06:58,271 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:06:58,271 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:06:58,271 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:06:58,271 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-1151283590 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:06:59,034 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-126897438 given task: attempt_20131031160444934_0005_m_000006_0
2013-10-31 16:06:59,209 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_1013282559 given task: attempt_20131031160444934_0006_m_000006_0
2013-10-31 16:06:59,318 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:06:59,319 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000002_0 not found in cache
2013-10-31 16:06:59,319 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000003_0 not found in cache
2013-10-31 16:06:59,319 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000005_0 not found in cache
2013-10-31 16:06:59,319 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0004 for user-log deletion with retainTimeStamp:1383322019319
2013-10-31 16:06:59,497 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:06:59,497 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000004_0 not found in cache
2013-10-31 16:06:59,498 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0004 for user-log deletion with retainTimeStamp:1383322019498
2013-10-31 16:06:59,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:06:59,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:00,052 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0004_m_-1475551417 since job job_20131031160444934_0004 is dead
2013-10-31 16:07:00,059 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12014 with signal TERM. Exit code 0
2013-10-31 16:07:00,171 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_7011938532533120784_1050
2013-10-31 16:07:00,211 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:00,212 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:00,212 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:00,213 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-1475551417 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:07:00,969 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0004_m_2107520939 since job job_20131031160444934_0004 is dead
2013-10-31 16:07:00,980 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12013 with signal TERM. Exit code 0
2013-10-31 16:07:01,155 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:01,155 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:01,155 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:01,156 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_2107520939 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:02,248 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0004
2013-10-31 16:07:02,249 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000001_0 not found in cache
2013-10-31 16:07:02,249 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0004_m_000000_0 not found in cache
2013-10-31 16:07:02,249 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0004 for user-log deletion with retainTimeStamp:1383322022249
2013-10-31 16:07:02,496 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000006_0 0.0% setup
2013-10-31 16:07:02,498 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000006_0 is done.
2013-10-31 16:07:02,499 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000006_0 was -1
2013-10-31 16:07:02,499 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:02,627 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000006_0 0.0% setup
2013-10-31 16:07:02,629 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000006_0 is done.
2013-10-31 16:07:02,630 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000006_0 was -1
2013-10-31 16:07:02,630 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:02,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7011938532533120784_1050 file build/test/data/dfs/data/data8/current/blk_7011938532533120784 for deletion
2013-10-31 16:07:02,871 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7011938532533120784_1050 at file build/test/data/dfs/data/data8/current/blk_7011938532533120784
2013-10-31 16:07:03,253 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000006_0' has completed task_20131031160444934_0005_m_000006 successfully.
2013-10-31 16:07:03,292 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0004_m_-389116012 since job job_20131031160444934_0004 is dead
2013-10-31 16:07:03,299 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group11976 with signal TERM. Exit code 0
2013-10-31 16:07:03,419 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000000_0' to tip task_20131031160444934_0005_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:03,422 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000000
2013-10-31 16:07:03,423 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000001_0' to tip task_20131031160444934_0005_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:03,423 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000001
2013-10-31 16:07:03,424 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000006_0' has completed task_20131031160444934_0006_m_000006 successfully.
2013-10-31 16:07:03,426 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:03,427 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:07:03,428 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000002_0' to tip task_20131031160444934_0005_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:07:03,428 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,428 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,428 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000002
2013-10-31 16:07:03,428 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000001_0 which needs 1 slots
2013-10-31 16:07:03,429 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000003_0' to tip task_20131031160444934_0005_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:07:03,429 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0005_m_000001_0 which needs 1 slots
2013-10-31 16:07:03,432 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000003
2013-10-31 16:07:03,437 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:07:03,438 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:07:03,438 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000002_0 which needs 1 slots
2013-10-31 16:07:03,439 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000002_0 which needs 1 slots
2013-10-31 16:07:03,439 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000003_0 which needs 1 slots
2013-10-31 16:07:03,439 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0005_m_000003_0 which needs 1 slots
2013-10-31 16:07:03,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken dst=null perm=null
2013-10-31 16:07:03,452 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47126, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_604723262076837153_1070, duration: 334869
2013-10-31 16:07:03,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml dst=null perm=null
2013-10-31 16:07:03,469 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34026, bytes: 28469, op: HDFS_READ, cliID: DFSClient_403873195, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3866472487802171399_1064, duration: 393740
2013-10-31 16:07:03,506 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0005_m_000004_0' to tip task_20131031160444934_0005_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:03,507 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0005_m_000004
2013-10-31 16:07:03,507 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000000_0' to tip task_20131031160444934_0006_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:03,508 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000000
2013-10-31 16:07:03,509 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:07:03,510 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:03,510 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000004_0 which needs 1 slots
2013-10-31 16:07:03,510 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000004_0 which needs 1 slots
2013-10-31 16:07:03,511 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,511 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0006_m_000000_0 which needs 1 slots
2013-10-31 16:07:03,590 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:03,592 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:03,593 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:03,593 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:03,595 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0004_m_-389116012 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:03,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005/jobToken dst=null perm=null
2013-10-31 16:07:03,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken dst=null perm=null
2013-10-31 16:07:03,597 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-751621141
2013-10-31 16:07:03,598 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-751621141 spawned.
2013-10-31 16:07:03,600 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0005/attempt_20131031160444934_0005_m_000000_0. Attempting to reuse: jvm_20131031160444934_0005_m_-126897438
2013-10-31 16:07:03,603 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47129, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_604723262076837153_1070, duration: 355448
2013-10-31 16:07:03,604 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000001_0/taskjvm.sh
2013-10-31 16:07:03,604 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54133, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1639395190201929201_1070, duration: 324787
2013-10-31 16:07:03,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.xml dst=null perm=null
2013-10-31 16:07:03,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml dst=null perm=null
2013-10-31 16:07:03,618 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34100, bytes: 28469, op: HDFS_READ, cliID: DFSClient_-744342643, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3866472487802171399_1064, duration: 432017
2013-10-31 16:07:03,618 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47134, bytes: 28461, op: HDFS_READ, cliID: DFSClient_1701704566, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5721256196737463602_1064, duration: 444225
2013-10-31 16:07:03,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar dst=null perm=null
2013-10-31 16:07:03,636 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34033, bytes: 239915, op: HDFS_READ, cliID: DFSClient_403873195, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8532132085552426957_1057, duration: 2134137
2013-10-31 16:07:03,640 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:03,642 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:03,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar dst=null perm=null
2013-10-31 16:07:03,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.jar dst=null perm=null
2013-10-31 16:07:03,656 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47136, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1701704566, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 820328
2013-10-31 16:07:03,657 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47137, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-744342643, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8532132085552426957_1057, duration: 851382
2013-10-31 16:07:03,810 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-921563826
2013-10-31 16:07:03,811 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-921563826 spawned.
2013-10-31 16:07:03,811 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0006_m_1013282559
2013-10-31 16:07:03,813 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000003_0/taskjvm.sh
2013-10-31 16:07:03,816 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12523 with signal TERM. Exit code 0
2013-10-31 16:07:03,816 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-919387719
2013-10-31 16:07:03,816 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-919387719 spawned.
2013-10-31 16:07:03,817 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000002_0/taskjvm.sh
2013-10-31 16:07:03,838 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_80173135
2013-10-31 16:07:03,839 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_80173135 spawned.
2013-10-31 16:07:03,839 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_-406446409
2013-10-31 16:07:03,839 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_-406446409 spawned.
2013-10-31 16:07:03,840 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000000_0/taskjvm.sh
2013-10-31 16:07:03,840 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000004_0/taskjvm.sh
2013-10-31 16:07:03,881 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:03,881 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:03,881 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:03,881 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_1013282559 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:04,063 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-126897438 given task: attempt_20131031160444934_0005_m_000000_0
2013-10-31 16:07:04,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=null
2013-10-31 16:07:04,170 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47139, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6361285198433998341_1060, duration: 186228
2013-10-31 16:07:04,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:07:04,272 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000001_0' to tip task_20131031160444934_0006_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:07:04,273 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000001
2013-10-31 16:07:04,273 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000002_0' to tip task_20131031160444934_0006_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:07:04,273 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000002
2013-10-31 16:07:04,274 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:07:04,275 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:07:04,275 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000001_0 which needs 1 slots
2013-10-31 16:07:04,275 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000001_0 which needs 1 slots
2013-10-31 16:07:04,275 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000002_0 which needs 1 slots
2013-10-31 16:07:04,275 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0006_m_000002_0 which needs 1 slots
2013-10-31 16:07:04,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken dst=null perm=null
2013-10-31 16:07:04,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34107, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1639395190201929201_1070, duration: 149635
2013-10-31 16:07:04,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml dst=null perm=null
2013-10-31 16:07:04,285 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34040, bytes: 28461, op: HDFS_READ, cliID: DFSClient_779080697, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5721256196737463602_1064, duration: 177880
2013-10-31 16:07:04,298 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:04,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar dst=null perm=null
2013-10-31 16:07:04,314 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34110, bytes: 239915, op: HDFS_READ, cliID: DFSClient_779080697, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6795492832038410935_1058, duration: 820709
2013-10-31 16:07:04,374 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_-245324502
2013-10-31 16:07:04,375 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_-245324502 spawned.
2013-10-31 16:07:04,375 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_-1130629699
2013-10-31 16:07:04,376 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_-1130629699 spawned.
2013-10-31 16:07:04,376 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000001_0/taskjvm.sh
2013-10-31 16:07:04,377 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000002_0/taskjvm.sh
2013-10-31 16:07:04,516 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47145, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 142662
2013-10-31 16:07:04,578 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-751621141 given task: attempt_20131031160444934_0005_m_000001_0
2013-10-31 16:07:05,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=null
2013-10-31 16:07:05,329 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54151, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 207707
2013-10-31 16:07:05,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:07:05,370 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47149, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 144536
2013-10-31 16:07:05,460 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-921563826 given task: attempt_20131031160444934_0005_m_000003_0
2013-10-31 16:07:05,771 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-406446409 given task: attempt_20131031160444934_0005_m_000004_0
2013-10-31 16:07:05,773 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_-919387719 given task: attempt_20131031160444934_0005_m_000002_0
2013-10-31 16:07:05,777 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_-1130629699 given task: attempt_20131031160444934_0006_m_000002_0
2013-10-31 16:07:05,799 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_80173135 given task: attempt_20131031160444934_0006_m_000000_0
2013-10-31 16:07:05,842 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_-245324502 given task: attempt_20131031160444934_0006_m_000001_0
2013-10-31 16:07:06,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=null
2013-10-31 16:07:06,042 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54159, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 278615
2013-10-31 16:07:06,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:07:06,084 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34055, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 148978
2013-10-31 16:07:06,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=null
2013-10-31 16:07:06,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005/job.split dst=null perm=null
2013-10-31 16:07:06,295 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47161, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6361285198433998341_1060, duration: 252782
2013-10-31 16:07:06,296 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54165, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6361285198433998341_1060, duration: 168356
2013-10-31 16:07:06,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=null
2013-10-31 16:07:06,327 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47164, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5739859526044531261_1061, duration: 188620
2013-10-31 16:07:06,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:07:06,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:07:06,335 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47165, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 140531
2013-10-31 16:07:06,336 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34064, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0005_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 110033
2013-10-31 16:07:06,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:07:06,370 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34135, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 166825
2013-10-31 16:07:06,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=null
2013-10-31 16:07:06,386 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34136, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 221796
2013-10-31 16:07:06,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:07:06,428 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47170, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 176715
2013-10-31 16:07:06,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=null
2013-10-31 16:07:06,441 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34138, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 186317
2013-10-31 16:07:06,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:07:06,730 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34070, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 152392
2013-10-31 16:07:07,134 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:07:07,137 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000000_0 is done.
2013-10-31 16:07:07,138 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000000_0 was 23
2013-10-31 16:07:07,138 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:08,253 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:07:08,256 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000001_0 is done.
2013-10-31 16:07:08,256 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000001_0 was 23
2013-10-31 16:07:08,257 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:08,428 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0005_m_000006_0
2013-10-31 16:07:08,428 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0005_m_000006_0
2013-10-31 16:07:08,428 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0005_m_000006_0 not found in cache
2013-10-31 16:07:08,438 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0006_m_000006_0
2013-10-31 16:07:08,439 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0006_m_000006_0
2013-10-31 16:07:08,439 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0006_m_000006_0 not found in cache
2013-10-31 16:07:08,957 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:07:08,959 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000003_0 is done.
2013-10-31 16:07:08,960 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000003_0 was 23
2013-10-31 16:07:08,960 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:09,220 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:07:09,222 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000002_0 is done.
2013-10-31 16:07:09,223 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000002_0 was 23
2013-10-31 16:07:09,223 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:09,224 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:07:09,226 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000004_0 is done.
2013-10-31 16:07:09,226 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000004_0 was 23
2013-10-31 16:07:09,227 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:09,250 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:07:09,251 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000002_0 is done.
2013-10-31 16:07:09,251 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000002_0 was 23
2013-10-31 16:07:09,251 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:09,310 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:07:09,313 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000001_0 is done.
2013-10-31 16:07:09,313 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000001_0 was 23
2013-10-31 16:07:09,313 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:09,367 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:07:09,369 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000000_0 is done.
2013-10-31 16:07:09,369 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000000_0 was 23
2013-10-31 16:07:09,369 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:09,431 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000000_0' has completed task_20131031160444934_0005_m_000000 successfully.
2013-10-31 16:07:09,432 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000001_0' has completed task_20131031160444934_0005_m_000001 successfully.
2013-10-31 16:07:09,434 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000003_0' to tip task_20131031160444934_0006_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:09,435 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000003
2013-10-31 16:07:09,435 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0006_m_000004_0' to tip task_20131031160444934_0006_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:09,436 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0006_m_000004
2013-10-31 16:07:09,445 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0005_r_000000_0' to tip task_20131031160444934_0005_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:09,447 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000002_0' has completed task_20131031160444934_0005_m_000002 successfully.
2013-10-31 16:07:09,448 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:07:09,450 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:07:09,450 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000003_0 which needs 1 slots
2013-10-31 16:07:09,451 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:09,451 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000003_0 which needs 1 slots
2013-10-31 16:07:09,451 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000003_0' has completed task_20131031160444934_0005_m_000003 successfully.
2013-10-31 16:07:09,451 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,452 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000004_0 which needs 1 slots
2013-10-31 16:07:09,452 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,452 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0006_m_000004_0 which needs 1 slots
2013-10-31 16:07:09,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006/jobToken dst=null perm=null
2013-10-31 16:07:09,464 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34140, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1639395190201929201_1070, duration: 318447
2013-10-31 16:07:09,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.xml dst=null perm=null
2013-10-31 16:07:09,476 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34142, bytes: 28461, op: HDFS_READ, cliID: DFSClient_1439700524, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5721256196737463602_1064, duration: 450463
2013-10-31 16:07:09,516 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000004_0' has completed task_20131031160444934_0005_m_000004 successfully.
2013-10-31 16:07:09,518 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000000_0' has completed task_20131031160444934_0006_m_000000 successfully.
2013-10-31 16:07:09,520 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0006_r_000000_0' to tip task_20131031160444934_0006_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:09,523 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_r_1565160902
2013-10-31 16:07:09,524 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_r_1565160902 spawned.
2013-10-31 16:07:09,525 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:09,525 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,526 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_r_000000_0 which needs 1 slots
2013-10-31 16:07:09,531 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_r_000000_0/taskjvm.sh
2013-10-31 16:07:09,558 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_r_-541739399
2013-10-31 16:07:09,559 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_r_-541739399 spawned.
2013-10-31 16:07:09,562 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_r_000000_0/taskjvm.sh
2013-10-31 16:07:09,727 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:09,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.jar dst=null perm=null
2013-10-31 16:07:09,760 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47176, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1439700524, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6795492832038410935_1058, duration: 1419735
2013-10-31 16:07:09,850 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0005_m_-751621141
2013-10-31 16:07:09,858 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12689 with signal TERM. Exit code 0
2013-10-31 16:07:09,858 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_-861004426
2013-10-31 16:07:09,859 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_-861004426 spawned.
2013-10-31 16:07:09,859 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0005_m_-126897438
2013-10-31 16:07:09,861 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000004_0/taskjvm.sh
2013-10-31 16:07:09,870 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12480 with signal TERM. Exit code 0
2013-10-31 16:07:09,870 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0006_m_1282739064
2013-10-31 16:07:09,871 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0006_m_1282739064 spawned.
2013-10-31 16:07:09,873 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0006/attempt_20131031160444934_0006_m_000003_0/taskjvm.sh
2013-10-31 16:07:09,936 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:09,936 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:09,936 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:09,936 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-126897438 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:07:09,956 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:09,957 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:09,957 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:09,957 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-751621141 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:10,279 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000001_0' has completed task_20131031160444934_0006_m_000001 successfully.
2013-10-31 16:07:10,280 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000002_0' has completed task_20131031160444934_0006_m_000002 successfully.
2013-10-31 16:07:10,672 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_r_-541739399 given task: attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:10,742 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_r_1565160902 given task: attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:10,853 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_1282739064 given task: attempt_20131031160444934_0006_m_000003_0
2013-10-31 16:07:10,866 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_-861004426 given task: attempt_20131031160444934_0006_m_000004_0
2013-10-31 16:07:11,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=null
2013-10-31 16:07:11,377 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34152, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5739859526044531261_1061, duration: 177859
2013-10-31 16:07:11,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006/job.split dst=null perm=null
2013-10-31 16:07:11,387 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34084, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5739859526044531261_1061, duration: 169028
2013-10-31 16:07:11,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:07:11,416 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34085, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 114033
2013-10-31 16:07:11,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:07:11,426 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34155, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0006_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 140159
2013-10-31 16:07:14,305 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:07:14,308 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000004_0 is done.
2013-10-31 16:07:14,309 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000004_0 was 23
2013-10-31 16:07:14,309 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:07:14,316 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:07:14,318 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000003_0 is done.
2013-10-31 16:07:14,319 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000003_0 was 23
2013-10-31 16:07:14,319 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:15,456 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000003_0' has completed task_20131031160444934_0006_m_000003 successfully.
2013-10-31 16:07:15,661 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000004_0' has completed task_20131031160444934_0006_m_000004 successfully.
2013-10-31 16:07:16,396 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:46687, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000000_0, duration: 16858411
2013-10-31 16:07:16,408 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57813, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000000_0, duration: 9184223
2013-10-31 16:07:16,414 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:45882, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000001_0, duration: 7850020
2013-10-31 16:07:16,422 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57813, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000001_0, duration: 6610592
2013-10-31 16:07:16,423 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:45882, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000002_0, duration: 5939610
2013-10-31 16:07:16,436 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42017, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000002_0, duration: 9784582
2013-10-31 16:07:16,452 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42017, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000003_0, duration: 11872954
2013-10-31 16:07:16,469 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:46691, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0005_m_000004_0, duration: 12420930
2013-10-31 16:07:17,162 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) >
2013-10-31 16:07:17,231 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:17,286 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:17,344 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:17,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:17,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:17,835 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000. blk_2997245466678193792_1071
2013-10-31 16:07:17,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2997245466678193792_1071 src: /127.0.0.1:34093 dest: /127.0.0.1:50942
2013-10-31 16:07:17,881 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2997245466678193792_1071 src: /127.0.0.1:54199 dest: /127.0.0.1:41648
2013-10-31 16:07:17,882 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2997245466678193792_1071 src: /127.0.0.1:47197 dest: /127.0.0.1:47311
2013-10-31 16:07:17,887 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47197, dest: /127.0.0.1:47311, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0005_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2997245466678193792_1071, duration: 2390734
2013-10-31 16:07:17,888 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2997245466678193792_1071 terminating
2013-10-31 16:07:17,888 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54199, dest: /127.0.0.1:41648, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0005_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2997245466678193792_1071, duration: 4182145
2013-10-31 16:07:17,888 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2997245466678193792_1071 terminating
2013-10-31 16:07:17,889 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34093, dest: /127.0.0.1:50942, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0005_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2997245466678193792_1071, duration: 4443919
2013-10-31 16:07:17,889 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2997245466678193792_1071 terminating
2013-10-31 16:07:17,892 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2997245466678193792_1071 size 180
2013-10-31 16:07:17,892 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2997245466678193792_1071 size 180
2013-10-31 16:07:17,892 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2997245466678193792_1071 size 180
2013-10-31 16:07:17,892 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:17,893 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:17,928 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0005_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:07:17,928 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:07:18,668 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0005_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:07:18,672 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:18,672 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 3 OK for attempt_20131031160444934_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:07:18,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0 dst=null perm=null
2013-10-31 16:07:18,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:18,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:18,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary/_attempt_20131031160444934_0005_r_000000_0 dst=null perm=null
2013-10-31 16:07:20,212 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) >
2013-10-31 16:07:20,276 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:20,279 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:20,280 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_r_000000_0 is done.
2013-10-31 16:07:20,280 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_r_000000_0 was -1
2013-10-31 16:07:20,282 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:21,446 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57821, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000003_0, duration: 14308681
2013-10-31 16:07:21,461 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57821, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0006_m_000004_0, duration: 11792784
2013-10-31 16:07:21,675 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_r_000000_0' has completed task_20131031160444934_0005_r_000000 successfully.
2013-10-31 16:07:21,681 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0005_m_000005_0' to tip task_20131031160444934_0005_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:21,684 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0005_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:07:21,684 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0005_m_000005_0 which needs 1 slots
2013-10-31 16:07:21,684 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0005_m_000005_0 which needs 1 slots
2013-10-31 16:07:21,716 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0006_m_-861004426
2013-10-31 16:07:21,723 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13314 with signal TERM. Exit code 0
2013-10-31 16:07:21,723 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0005_m_527717294
2013-10-31 16:07:21,723 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0005_m_527717294 spawned.
2013-10-31 16:07:21,726 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0005/attempt_20131031160444934_0005_m_000005_0/taskjvm.sh
2013-10-31 16:07:21,839 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:21,840 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:21,840 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:21,840 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_-861004426 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:22,220 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) >
2013-10-31 16:07:22,276 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) >
2013-10-31 16:07:22,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:22,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:22,497 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000. blk_2693516798230755184_1072
2013-10-31 16:07:22,519 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2693516798230755184_1072 src: /127.0.0.1:54203 dest: /127.0.0.1:41648
2013-10-31 16:07:22,520 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2693516798230755184_1072 src: /127.0.0.1:34100 dest: /127.0.0.1:50942
2013-10-31 16:07:22,520 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2693516798230755184_1072 src: /127.0.0.1:34170 dest: /127.0.0.1:38271
2013-10-31 16:07:22,522 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34170, dest: /127.0.0.1:38271, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0006_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2693516798230755184_1072, duration: 1009448
2013-10-31 16:07:22,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2693516798230755184_1072 terminating
2013-10-31 16:07:22,523 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34100, dest: /127.0.0.1:50942, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0006_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2693516798230755184_1072, duration: 1458855
2013-10-31 16:07:22,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2693516798230755184_1072 terminating
2013-10-31 16:07:22,523 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54203, dest: /127.0.0.1:41648, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0006_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2693516798230755184_1072, duration: 1876655
2013-10-31 16:07:22,524 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2693516798230755184_1072 terminating
2013-10-31 16:07:22,525 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2693516798230755184_1072 size 180
2013-10-31 16:07:22,527 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2693516798230755184_1072 size 180
2013-10-31 16:07:22,527 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:22,527 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:22,527 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2693516798230755184_1072 size 180
2013-10-31 16:07:22,565 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0006_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:07:22,565 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 0.20000002% reduce > copy (3 of 5 at 0.00 MB/s) >
2013-10-31 16:07:22,698 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0005_m_527717294 given task: attempt_20131031160444934_0005_m_000005_0
2013-10-31 16:07:23,197 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000005_0 0.0%
2013-10-31 16:07:23,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_temporary dst=null perm=null
2013-10-31 16:07:23,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:23,223 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_SUCCESS from client DFSClient_attempt_20131031160444934_0005_m_000005_0
2013-10-31 16:07:23,223 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0005_m_000005_0
2013-10-31 16:07:23,229 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:23,229 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,229 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:23,229 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8532132085552426957 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:23,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6361285198433998341 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:23,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4742838560224575816 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:23,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4742838560224575816 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4742838560224575816 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3866472487802171399 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:23,232 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3866472487802171399 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:23,232 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3866472487802171399 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:23,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0005 dst=null perm=null
2013-10-31 16:07:24,177 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8532132085552426957_1057 blk_3866472487802171399_1064 blk_-6361285198433998341_1060
2013-10-31 16:07:24,177 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-8532132085552426957_1057 blk_4742838560224575816_1062 blk_-6361285198433998341_1060
2013-10-31 16:07:24,276 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data4/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:24,276 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data4/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:24,276 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data4/current/blk_-8532132085552426957
2013-10-31 16:07:24,276 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4742838560224575816_1062 file build/test/data/dfs/data/data4/current/blk_4742838560224575816 for deletion
2013-10-31 16:07:24,277 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data4/current/blk_-6361285198433998341
2013-10-31 16:07:24,277 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4742838560224575816_1062 at file build/test/data/dfs/data/data4/current/blk_4742838560224575816
2013-10-31 16:07:24,690 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 2 OK for attempt_20131031160444934_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:07:24,691 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:24,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data5/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:24,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data5/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:24,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3866472487802171399_1064 file build/test/data/dfs/data/data5/current/blk_3866472487802171399 for deletion
2013-10-31 16:07:24,890 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data5/current/blk_-8532132085552426957
2013-10-31 16:07:24,890 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data5/current/blk_-6361285198433998341
2013-10-31 16:07:24,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3866472487802171399_1064 at file build/test/data/dfs/data/data5/current/blk_3866472487802171399
2013-10-31 16:07:25,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0 dst=null perm=null
2013-10-31 16:07:25,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:25,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:25,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary/_attempt_20131031160444934_0006_r_000000_0 dst=null perm=null
2013-10-31 16:07:26,130 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0005_m_000005_0 0.0% cleanup
2013-10-31 16:07:26,132 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0005_m_000005_0 is done.
2013-10-31 16:07:26,132 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0005_m_000005_0 was -1
2013-10-31 16:07:26,132 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:26,268 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:26,270 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 16:07:26,272 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_r_000000_0 is done.
2013-10-31 16:07:26,272 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_r_000000_0 was -1
2013-10-31 16:07:26,273 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:26,684 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:26,685 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0005_r_000000_0
2013-10-31 16:07:27,178 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-8532132085552426957_1057 blk_3866472487802171399_1064 blk_4742838560224575816_1062 blk_-6361285198433998341_1060
2013-10-31 16:07:27,178 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-8532132085552426957_1057 blk_3866472487802171399_1064 blk_4742838560224575816_1062 blk_-6361285198433998341_1060
2013-10-31 16:07:27,692 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0005_m_000005_0' has completed task_20131031160444934_0005_m_000005 successfully.
2013-10-31 16:07:27,921 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0005 has completed successfully.
2013-10-31 16:07:27,921 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0005,submitTime=1383235615711,launchTime=1383235616289,firstMapTaskLaunchTime=1383235623419,firstReduceTaskLaunchTime=1383235629436,firstJobSetupTaskLaunchTime=1383235617240,firstJobCleanupTaskLaunchTime=1383235641681,finishTime=1383235647921,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2CC911EB25C3440AB1D0D1C97C8C5190/6DA129A1920447BCB7A07D38023CB8FC] lower*upper/(1/3)
2013-10-31 16:07:27,928 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC. blk_-7119686764560670206_1073
2013-10-31 16:07:27,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119686764560670206_1073 src: /127.0.0.1:34175 dest: /127.0.0.1:38271
2013-10-31 16:07:27,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119686764560670206_1073 src: /127.0.0.1:54212 dest: /127.0.0.1:41648
2013-10-31 16:07:27,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119686764560670206_1073 src: /127.0.0.1:47210 dest: /127.0.0.1:47311
2013-10-31 16:07:27,957 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47210, dest: /127.0.0.1:47311, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7119686764560670206_1073, duration: 246968
2013-10-31 16:07:27,957 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7119686764560670206_1073 terminating
2013-10-31 16:07:27,958 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54212, dest: /127.0.0.1:41648, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7119686764560670206_1073, duration: 1044983
2013-10-31 16:07:27,958 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7119686764560670206_1073 terminating
2013-10-31 16:07:27,959 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34175, dest: /127.0.0.1:38271, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_-63336241, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119686764560670206_1073, duration: 1937524
2013-10-31 16:07:27,959 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7119686764560670206_1073 terminating
2013-10-31 16:07:27,961 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7119686764560670206_1073 size 31965
2013-10-31 16:07:27,961 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC from client DFSClient_-63336241
2013-10-31 16:07:27,962 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/_logs/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC is closed by DFSClient_-63336241
2013-10-31 16:07:27,963 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7119686764560670206_1073 size 31965
2013-10-31 16:07:27,963 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7119686764560670206_1073 size 31965
2013-10-31 16:07:27,968 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0005_1383235615711_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F6DA129A1920447BC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:27,970 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000000_0'
2013-10-31 16:07:27,970 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000001_0'
2013-10-31 16:07:27,972 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000005_0'
2013-10-31 16:07:27,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_604723262076837153 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:27,972 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000006_0'
2013-10-31 16:07:27,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_604723262076837153 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:27,973 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_r_000000_0'
2013-10-31 16:07:27,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_604723262076837153 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:27,974 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000002_0'
2013-10-31 16:07:27,974 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000003_0'
2013-10-31 16:07:27,975 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_r_000000_0' has completed task_20131031160444934_0006_r_000000 successfully.
2013-10-31 16:07:27,977 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0005_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:27,981 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0006_m_000005_0' to tip task_20131031160444934_0006_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:07:27,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0005 dst=null perm=null
2013-10-31 16:07:27,982 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0005_m_000004_0'
2013-10-31 16:07:27,986 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0006_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:07:27,986 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0006_m_000005_0 which needs 1 slots
2013-10-31 16:07:27,987 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0006_m_000005_0 which needs 1 slots
2013-10-31 16:07:28,019 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0006/attempt_20131031160444934_0006_m_000005_0. Attempting to reuse: jvm_20131031160444934_0006_m_80173135
2013-10-31 16:07:28,301 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:28,302 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0005 being deleted.
2013-10-31 16:07:29,451 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0006_m_80173135 given task: attempt_20131031160444934_0006_m_000005_0
2013-10-31 16:07:29,587 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000005_0 0.0%
2013-10-31 16:07:29,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_temporary dst=null perm=null
2013-10-31 16:07:29,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:29,605 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_SUCCESS from client DFSClient_attempt_20131031160444934_0006_m_000005_0
2013-10-31 16:07:29,606 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0006_m_000005_0
2013-10-31 16:07:29,611 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,611 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,612 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:29,612 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6795492832038410935 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,612 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,612 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,612 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:29,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5739859526044531261 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5582207694431061275 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5582207694431061275 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5582207694431061275 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5721256196737463602 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:29,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5721256196737463602 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:29,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5721256196737463602 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:29,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0006 dst=null perm=null
2013-10-31 16:07:29,677 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data1/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:29,678 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data2/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:29,678 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3866472487802171399_1064 file build/test/data/dfs/data/data2/current/blk_3866472487802171399 for deletion
2013-10-31 16:07:29,678 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4742838560224575816_1062 file build/test/data/dfs/data/data2/current/blk_4742838560224575816 for deletion
2013-10-31 16:07:29,678 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data2/current/blk_-6361285198433998341
2013-10-31 16:07:29,678 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data1/current/blk_-8532132085552426957
2013-10-31 16:07:29,678 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3866472487802171399_1064 at file build/test/data/dfs/data/data2/current/blk_3866472487802171399
2013-10-31 16:07:29,679 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4742838560224575816_1062 at file build/test/data/dfs/data/data2/current/blk_4742838560224575816
2013-10-31 16:07:29,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8532132085552426957_1057 file build/test/data/dfs/data/data8/current/blk_-8532132085552426957 for deletion
2013-10-31 16:07:29,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6361285198433998341_1060 file build/test/data/dfs/data/data7/current/blk_-6361285198433998341 for deletion
2013-10-31 16:07:29,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8532132085552426957_1057 at file build/test/data/dfs/data/data8/current/blk_-8532132085552426957
2013-10-31 16:07:29,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6361285198433998341_1060 at file build/test/data/dfs/data/data7/current/blk_-6361285198433998341
2013-10-31 16:07:29,880 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3866472487802171399_1064 file build/test/data/dfs/data/data7/current/blk_3866472487802171399 for deletion
2013-10-31 16:07:29,881 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4742838560224575816_1062 file build/test/data/dfs/data/data7/current/blk_4742838560224575816 for deletion
2013-10-31 16:07:29,881 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3866472487802171399_1064 at file build/test/data/dfs/data/data7/current/blk_3866472487802171399
2013-10-31 16:07:29,882 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4742838560224575816_1062 at file build/test/data/dfs/data/data7/current/blk_4742838560224575816
2013-10-31 16:07:30,179 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_604723262076837153_1070 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:30,179 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-5582207694431061275_1063 blk_-5721256196737463602_1064 blk_604723262076837153_1070 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:30,278 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5721256196737463602_1064 file build/test/data/dfs/data/data4/current/blk_-5721256196737463602 for deletion
2013-10-31 16:07:30,278 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5582207694431061275_1063 file build/test/data/dfs/data/data3/current/blk_-5582207694431061275 for deletion
2013-10-31 16:07:30,278 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5721256196737463602_1064 at file build/test/data/dfs/data/data4/current/blk_-5721256196737463602
2013-10-31 16:07:30,279 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_604723262076837153_1070 file build/test/data/dfs/data/data3/current/blk_604723262076837153 for deletion
2013-10-31 16:07:30,279 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5582207694431061275_1063 at file build/test/data/dfs/data/data3/current/blk_-5582207694431061275
2013-10-31 16:07:30,279 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data3/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:30,279 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_604723262076837153_1070 at file build/test/data/dfs/data/data3/current/blk_604723262076837153
2013-10-31 16:07:30,280 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data3/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:30,280 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data3/current/blk_5739859526044531261
2013-10-31 16:07:30,280 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data3/current/blk_6795492832038410935
2013-10-31 16:07:30,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_604723262076837153_1070 file build/test/data/dfs/data/data6/current/blk_604723262076837153 for deletion
2013-10-31 16:07:30,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data6/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:30,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_604723262076837153_1070 at file build/test/data/dfs/data/data6/current/blk_604723262076837153
2013-10-31 16:07:30,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data6/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:30,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data6/current/blk_5739859526044531261
2013-10-31 16:07:30,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data6/current/blk_6795492832038410935
2013-10-31 16:07:32,538 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0006_m_000005_0 0.0% cleanup
2013-10-31 16:07:32,541 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0006_m_000005_0 is done.
2013-10-31 16:07:32,541 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0006_m_000005_0 was -1
2013-10-31 16:07:32,542 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:32,974 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:32,974 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0005_m_000005_0 not found in cache
2013-10-31 16:07:32,975 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:32,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0005 for user-log deletion with retainTimeStamp:1383322052975
2013-10-31 16:07:32,976 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0005 for user-log deletion with retainTimeStamp:1383322052976
2013-10-31 16:07:32,987 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:32,987 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0006_r_000000_0
2013-10-31 16:07:33,179 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-5582207694431061275_1063 blk_-5721256196737463602_1064 blk_604723262076837153_1070 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:33,180 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5582207694431061275_1063 blk_-5721256196737463602_1064 blk_6795492832038410935_1058 blk_5739859526044531261_1061
2013-10-31 16:07:33,550 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_-921563826 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:33,560 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12795 with signal TERM. Exit code 0
2013-10-31 16:07:33,800 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_-919387719 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:33,807 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12831 with signal TERM. Exit code 0
2013-10-31 16:07:33,815 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:33,816 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:33,816 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:33,816 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-921563826 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:33,992 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0006_m_000005_0' has completed task_20131031160444934_0006_m_000005 successfully.
2013-10-31 16:07:33,993 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0006 has completed successfully.
2013-10-31 16:07:33,994 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0006,submitTime=1383235615747,launchTime=1383235616296,firstMapTaskLaunchTime=1383235623507,firstReduceTaskLaunchTime=1383235629520,firstJobSetupTaskLaunchTime=1383235617324,firstJobCleanupTaskLaunchTime=1383235647981,finishTime=1383235653993,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2CC911EB25C3440AB1D0D1C97C8C5190/D4DBD78318DD492EAD89E9C4866521C6] lower*upper/(2/3)
2013-10-31 16:07:34,000 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E. blk_2659110045914674593_1074
2013-10-31 16:07:34,002 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2659110045914674593_1074 src: /127.0.0.1:54220 dest: /127.0.0.1:41648
2013-10-31 16:07:34,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2659110045914674593_1074 src: /127.0.0.1:47218 dest: /127.0.0.1:47311
2013-10-31 16:07:34,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2659110045914674593_1074 src: /127.0.0.1:34117 dest: /127.0.0.1:50942
2013-10-31 16:07:34,007 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34117, dest: /127.0.0.1:50942, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2659110045914674593_1074, duration: 242023
2013-10-31 16:07:34,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2659110045914674593_1074 terminating
2013-10-31 16:07:34,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47218, dest: /127.0.0.1:47311, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2659110045914674593_1074, duration: 1064460
2013-10-31 16:07:34,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2659110045914674593_1074 terminating
2013-10-31 16:07:34,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54220, dest: /127.0.0.1:41648, bytes: 31965, op: HDFS_WRITE, cliID: DFSClient_898051513, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2659110045914674593_1074, duration: 1450552
2013-10-31 16:07:34,009 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2659110045914674593_1074 terminating
2013-10-31 16:07:34,011 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2659110045914674593_1074 size 31965
2013-10-31 16:07:34,011 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E from client DFSClient_898051513
2013-10-31 16:07:34,011 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/_logs/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E is closed by DFSClient_898051513
2013-10-31 16:07:34,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2659110045914674593_1074 size 31965
2013-10-31 16:07:34,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2659110045914674593_1074 size 31965
2013-10-31 16:07:34,017 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000000_0'
2013-10-31 16:07:34,017 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0006_1383235615747_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2FD4DBD78318DD492E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:34,017 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000005_0'
2013-10-31 16:07:34,018 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1639395190201929201 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:34,018 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_r_000000_0'
2013-10-31 16:07:34,018 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1639395190201929201 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:34,019 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1639395190201929201 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:34,021 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (3/3) ...dpipesplatform/afterevery
2013-10-31 16:07:34,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0006 dst=null perm=null
2013-10-31 16:07:34,023 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0006_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:34,027 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:07:34,027 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:07:34,048 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:34,048 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:34,048 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:34,048 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-919387719 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:34,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:34,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:07:34,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,182 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar. blk_8838228819783861941_1075
2013-10-31 16:07:34,184 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:34118 dest: /127.0.0.1:50942
2013-10-31 16:07:34,186 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:34188 dest: /127.0.0.1:38271
2013-10-31 16:07:34,187 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:54225 dest: /127.0.0.1:41648
2013-10-31 16:07:34,195 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54225, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8838228819783861941_1075, duration: 3755733
2013-10-31 16:07:34,195 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8838228819783861941_1075 terminating
2013-10-31 16:07:34,195 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34188, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8838228819783861941_1075, duration: 4571118
2013-10-31 16:07:34,196 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8838228819783861941_1075 terminating
2013-10-31 16:07:34,196 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34118, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8838228819783861941_1075, duration: 5952677
2013-10-31 16:07:34,197 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8838228819783861941_1075 terminating
2013-10-31 16:07:34,199 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_527717294 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:34,199 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:34,201 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar from client DFSClient_1457307213
2013-10-31 16:07:34,201 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar is closed by DFSClient_1457307213
2013-10-31 16:07:34,202 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:34,202 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:34,207 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar. New replication is 10
2013-10-31 16:07:34,210 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13558 with signal TERM. Exit code 0
2013-10-31 16:07:34,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar dst=null perm=null
2013-10-31 16:07:34,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,219 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:07:34,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997 dst=null perm=null
2013-10-31 16:07:34,226 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:34,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000 dst=null perm=null
2013-10-31 16:07:34,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,248 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split. New replication is 10
2013-10-31 16:07:34,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split dst=null perm=null
2013-10-31 16:07:34,254 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split. blk_2028997783111402336_1076
2013-10-31 16:07:34,255 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:34121 dest: /127.0.0.1:50942
2013-10-31 16:07:34,255 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:34191 dest: /127.0.0.1:38271
2013-10-31 16:07:34,256 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:54228 dest: /127.0.0.1:41648
2013-10-31 16:07:34,257 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2028997783111402336_1076 src: /127.0.0.1:47226 dest: /127.0.0.1:47311
2013-10-31 16:07:34,258 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47226, dest: /127.0.0.1:47311, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2028997783111402336_1076, duration: 30213
2013-10-31 16:07:34,258 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,258 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54228, dest: /127.0.0.1:41648, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2028997783111402336_1076, duration: 348137
2013-10-31 16:07:34,258 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,259 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34191, dest: /127.0.0.1:38271, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2028997783111402336_1076, duration: 697394
2013-10-31 16:07:34,259 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,259 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34121, dest: /127.0.0.1:50942, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2028997783111402336_1076, duration: 1179930
2013-10-31 16:07:34,259 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2028997783111402336_1076 terminating
2013-10-31 16:07:34,261 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,262 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split from client DFSClient_1457307213
2013-10-31 16:07:34,262 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split is closed by DFSClient_1457307213
2013-10-31 16:07:34,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2028997783111402336_1076 size 352
2013-10-31 16:07:34,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,280 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo. blk_-4067490714316058154_1077
2013-10-31 16:07:34,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4067490714316058154_1077 src: /127.0.0.1:47227 dest: /127.0.0.1:47311
2013-10-31 16:07:34,282 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4067490714316058154_1077 src: /127.0.0.1:34126 dest: /127.0.0.1:50942
2013-10-31 16:07:34,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4067490714316058154_1077 src: /127.0.0.1:34196 dest: /127.0.0.1:38271
2013-10-31 16:07:34,285 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34196, dest: /127.0.0.1:38271, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4067490714316058154_1077, duration: 40582
2013-10-31 16:07:34,285 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4067490714316058154_1077 terminating
2013-10-31 16:07:34,285 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4067490714316058154_1077 size 44
2013-10-31 16:07:34,285 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34126, dest: /127.0.0.1:50942, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4067490714316058154_1077, duration: 1438654
2013-10-31 16:07:34,286 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4067490714316058154_1077 terminating
2013-10-31 16:07:34,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47227, dest: /127.0.0.1:47311, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4067490714316058154_1077, duration: 1955271
2013-10-31 16:07:34,286 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4067490714316058154_1077 terminating
2013-10-31 16:07:34,287 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:07:34,287 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:07:34,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4067490714316058154_1077 size 44
2013-10-31 16:07:34,289 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4067490714316058154_1077 size 44
2013-10-31 16:07:34,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,306 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000001_0'
2013-10-31 16:07:34,306 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml. blk_4137129478089268586_1078
2013-10-31 16:07:34,306 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000002_0'
2013-10-31 16:07:34,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4137129478089268586_1078 src: /127.0.0.1:47230 dest: /127.0.0.1:47311
2013-10-31 16:07:34,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4137129478089268586_1078 src: /127.0.0.1:34129 dest: /127.0.0.1:50942
2013-10-31 16:07:34,310 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4137129478089268586_1078 src: /127.0.0.1:54235 dest: /127.0.0.1:41648
2013-10-31 16:07:34,313 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54235, dest: /127.0.0.1:41648, bytes: 28800, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4137129478089268586_1078, duration: 1033929
2013-10-31 16:07:34,313 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4137129478089268586_1078 terminating
2013-10-31 16:07:34,313 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4137129478089268586_1078 size 28800
2013-10-31 16:07:34,313 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34129, dest: /127.0.0.1:50942, bytes: 28800, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4137129478089268586_1078, duration: 612898
2013-10-31 16:07:34,314 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4137129478089268586_1078 terminating
2013-10-31 16:07:34,314 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47230, dest: /127.0.0.1:47311, bytes: 28800, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4137129478089268586_1078, duration: 1660751
2013-10-31 16:07:34,315 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4137129478089268586_1078 terminating
2013-10-31 16:07:34,316 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4137129478089268586_1078 size 28800
2013-10-31 16:07:34,316 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml from client DFSClient_1457307213
2013-10-31 16:07:34,317 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml is closed by DFSClient_1457307213
2013-10-31 16:07:34,317 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4137129478089268586_1078 size 28800
2013-10-31 16:07:34,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml dst=null perm=null
2013-10-31 16:07:34,327 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_r_1565160902 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:34,331 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34132, bytes: 29028, op: HDFS_READ, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4137129478089268586_1078, duration: 494467
2013-10-31 16:07:34,335 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13198 with signal TERM. Exit code 0
2013-10-31 16:07:34,351 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0007: nMaps=1 nReduces=0 max=-1
2013-10-31 16:07:34,351 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0007 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:07:34,351 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0007
2013-10-31 16:07:34,351 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0007 RESULT=SUCCESS
2013-10-31 16:07:34,351 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0007
2013-10-31 16:07:34,352 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0007
2013-10-31 16:07:34,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,383 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:34,383 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:34,383 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:34,383 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_527717294 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:34,502 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:34,502 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:34,502 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:34,502 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_r_1565160902 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:34,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,861 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml. blk_6838092899154676359_1080
2013-10-31 16:07:34,863 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6838092899154676359_1080 src: /127.0.0.1:54238 dest: /127.0.0.1:41648
2013-10-31 16:07:34,865 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6838092899154676359_1080 src: /127.0.0.1:47236 dest: /127.0.0.1:47311
2013-10-31 16:07:34,866 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6838092899154676359_1080 src: /127.0.0.1:34204 dest: /127.0.0.1:38271
2013-10-31 16:07:34,871 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34204, dest: /127.0.0.1:38271, bytes: 28865, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6838092899154676359_1080, duration: 713421
2013-10-31 16:07:34,871 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6838092899154676359_1080 terminating
2013-10-31 16:07:34,872 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47236, dest: /127.0.0.1:47311, bytes: 28865, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6838092899154676359_1080, duration: 1489019
2013-10-31 16:07:34,872 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6838092899154676359_1080 terminating
2013-10-31 16:07:34,873 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54238, dest: /127.0.0.1:41648, bytes: 28865, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6838092899154676359_1080, duration: 2508359
2013-10-31 16:07:34,873 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6838092899154676359_1080 terminating
2013-10-31 16:07:34,873 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6838092899154676359_1080 size 28865
2013-10-31 16:07:34,879 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml from client DFSClient_1197825700
2013-10-31 16:07:34,879 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_conf.xml is closed by DFSClient_1197825700
2013-10-31 16:07:34,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6838092899154676359_1080 size 28865
2013-10-31 16:07:34,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6838092899154676359_1080 size 28865
2013-10-31 16:07:34,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:34,894 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken. blk_-8749881692688222416_1081
2013-10-31 16:07:34,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8749881692688222416_1081 src: /127.0.0.1:34136 dest: /127.0.0.1:50942
2013-10-31 16:07:34,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8749881692688222416_1081 src: /127.0.0.1:34206 dest: /127.0.0.1:38271
2013-10-31 16:07:34,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8749881692688222416_1081 src: /127.0.0.1:47240 dest: /127.0.0.1:47311
2013-10-31 16:07:34,902 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47240, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8749881692688222416_1081, duration: 65109
2013-10-31 16:07:34,903 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8749881692688222416_1081 terminating
2013-10-31 16:07:34,903 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34206, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8749881692688222416_1081, duration: 928181
2013-10-31 16:07:34,904 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8749881692688222416_1081 terminating
2013-10-31 16:07:34,904 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8749881692688222416_1081 size 116
2013-10-31 16:07:34,904 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34136, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8749881692688222416_1081, duration: 1747348
2013-10-31 16:07:34,905 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8749881692688222416_1081 terminating
2013-10-31 16:07:34,907 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8749881692688222416_1081 size 116
2013-10-31 16:07:34,907 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken from client DFSClient_1457307213
2013-10-31 16:07:34,908 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken is closed by DFSClient_1457307213
2013-10-31 16:07:34,908 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8749881692688222416_1081 size 116
2013-10-31 16:07:34,913 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken
2013-10-31 16:07:34,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.splitmetainfo dst=null perm=null
2013-10-31 16:07:34,918 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47241, bytes: 48, op: HDFS_READ, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4067490714316058154_1077, duration: 281578
2013-10-31 16:07:34,918 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0007 = 180. Number of splits = 1
2013-10-31 16:07:34,918 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:34,919 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:34,919 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:34,919 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0007 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:07:34,920 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0007 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 16:07:35,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5721256196737463602_1064 file build/test/data/dfs/data/data1/current/blk_-5721256196737463602 for deletion
2013-10-31 16:07:35,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5582207694431061275_1063 file build/test/data/dfs/data/data1/current/blk_-5582207694431061275 for deletion
2013-10-31 16:07:35,681 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data1/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:35,681 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data2/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:35,882 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5721256196737463602_1064 file build/test/data/dfs/data/data8/current/blk_-5721256196737463602 for deletion
2013-10-31 16:07:35,882 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5582207694431061275_1063 file build/test/data/dfs/data/data8/current/blk_-5582207694431061275 for deletion
2013-10-31 16:07:35,882 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_604723262076837153_1070 file build/test/data/dfs/data/data8/current/blk_604723262076837153 for deletion
2013-10-31 16:07:35,883 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5739859526044531261_1061 file build/test/data/dfs/data/data8/current/blk_5739859526044531261 for deletion
2013-10-31 16:07:35,883 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6795492832038410935_1058 file build/test/data/dfs/data/data8/current/blk_6795492832038410935 for deletion
2013-10-31 16:07:36,176 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5721256196737463602_1064 at file build/test/data/dfs/data/data1/current/blk_-5721256196737463602
2013-10-31 16:07:36,176 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data2/current/blk_6795492832038410935
2013-10-31 16:07:36,176 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5582207694431061275_1063 at file build/test/data/dfs/data/data1/current/blk_-5582207694431061275
2013-10-31 16:07:36,176 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5721256196737463602_1064 at file build/test/data/dfs/data/data8/current/blk_-5721256196737463602
2013-10-31 16:07:36,176 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data1/current/blk_5739859526044531261
2013-10-31 16:07:36,177 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5582207694431061275_1063 at file build/test/data/dfs/data/data8/current/blk_-5582207694431061275
2013-10-31 16:07:36,177 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_604723262076837153_1070 at file build/test/data/dfs/data/data8/current/blk_604723262076837153
2013-10-31 16:07:36,177 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5739859526044531261_1061 at file build/test/data/dfs/data/data8/current/blk_5739859526044531261
2013-10-31 16:07:36,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6795492832038410935_1058 at file build/test/data/dfs/data/data8/current/blk_6795492832038410935
2013-10-31 16:07:36,180 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_8838228819783861941_1075 to datanode(s) 127.0.0.1:47311
2013-10-31 16:07:36,181 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_1639395190201929201_1070
2013-10-31 16:07:36,181 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_1639395190201929201_1070
2013-10-31 16:07:36,893 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_8838228819783861941_1075 to 127.0.0.1:47311
2013-10-31 16:07:36,894 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1639395190201929201_1070 file build/test/data/dfs/data/data5/current/blk_1639395190201929201 for deletion
2013-10-31 16:07:36,894 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1639395190201929201_1070 at file build/test/data/dfs/data/data5/current/blk_1639395190201929201
2013-10-31 16:07:36,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838228819783861941_1075 src: /127.0.0.1:47242 dest: /127.0.0.1:47311
2013-10-31 16:07:36,896 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_8838228819783861941_1075 to /127.0.0.1:47311
2013-10-31 16:07:36,900 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8838228819783861941_1075 src: /127.0.0.1:47242 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:07:36,904 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8838228819783861941_1075 size 238055
2013-10-31 16:07:36,983 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0007_m_000002_0' to tip task_20131031160444934_0007_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:36,987 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000003_0'
2013-10-31 16:07:36,987 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000004_0'
2013-10-31 16:07:36,992 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0007_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:07:36,992 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0006_m_000006_0'
2013-10-31 16:07:36,992 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0007_m_000002_0 which needs 1 slots
2013-10-31 16:07:36,993 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0007_m_000002_0 which needs 1 slots
2013-10-31 16:07:36,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007/jobToken dst=null perm=null
2013-10-31 16:07:37,002 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47243, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8749881692688222416_1081, duration: 303176
2013-10-31 16:07:37,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.xml dst=null perm=null
2013-10-31 16:07:37,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54248, bytes: 29028, op: HDFS_READ, cliID: DFSClient_2143540042, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4137129478089268586_1078, duration: 388549
2013-10-31 16:07:37,043 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:37,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.jar dst=null perm=null
2013-10-31 16:07:37,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34213, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2143540042, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8838228819783861941_1075, duration: 1633651
2013-10-31 16:07:37,178 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0007_m_-1232237882
2013-10-31 16:07:37,179 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0007_m_-1232237882 spawned.
2013-10-31 16:07:37,180 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0007/attempt_20131031160444934_0007_m_000002_0/taskjvm.sh
2013-10-31 16:07:37,987 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0005
2013-10-31 16:07:37,989 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0005 for user-log deletion with retainTimeStamp:1383322057988
2013-10-31 16:07:38,307 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0005_m_-406446409 since job job_20131031160444934_0005 is dead
2013-10-31 16:07:38,313 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12833 with signal TERM. Exit code 0
2013-10-31 16:07:38,525 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:38,525 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:38,525 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:38,525 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0005_m_-406446409 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:38,545 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0007_m_-1232237882 given task: attempt_20131031160444934_0007_m_000002_0
2013-10-31 16:07:38,882 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1639395190201929201_1070 file build/test/data/dfs/data/data7/current/blk_1639395190201929201 for deletion
2013-10-31 16:07:38,883 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1639395190201929201_1070 at file build/test/data/dfs/data/data7/current/blk_1639395190201929201
2013-10-31 16:07:39,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:39,182 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_1639395190201929201_1070
2013-10-31 16:07:39,307 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:39,308 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322059308
2013-10-31 16:07:39,822 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_-1130629699 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:39,832 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12830 with signal TERM. Exit code 0
2013-10-31 16:07:39,854 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:07:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,881 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,887 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,899 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_-245324502 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:39,901 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:07:39,901 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:07:39,907 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12832 with signal TERM. Exit code 0
2013-10-31 16:07:40,042 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:40,042 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:40,042 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:40,042 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_-1130629699 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:40,091 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:40,091 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:40,091 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:40,091 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_-245324502 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:41,682 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1639395190201929201_1070 file build/test/data/dfs/data/data1/current/blk_1639395190201929201 for deletion
2013-10-31 16:07:41,682 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1639395190201929201_1070 at file build/test/data/dfs/data/data1/current/blk_1639395190201929201
2013-10-31 16:07:41,969 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000002_0 0.0% setup
2013-10-31 16:07:41,972 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0007_m_000002_0 is done.
2013-10-31 16:07:41,972 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0007_m_000002_0 was -1
2013-10-31 16:07:41,973 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:41,992 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:41,993 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322061993
2013-10-31 16:07:41,993 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:41,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322061994
2013-10-31 16:07:42,989 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0006
2013-10-31 16:07:42,990 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0006_m_000005_0 not found in cache
2013-10-31 16:07:42,991 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0006 for user-log deletion with retainTimeStamp:1383322062990
2013-10-31 16:07:42,995 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0007_m_000002_0' has completed task_20131031160444934_0007_m_000002 successfully.
2013-10-31 16:07:42,998 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0007_m_000000_0' to tip task_20131031160444934_0007_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:42,999 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0007_m_000000
2013-10-31 16:07:43,002 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0007_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:07:43,002 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0007_m_000000_0 which needs 1 slots
2013-10-31 16:07:43,002 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0007_m_000000_0 which needs 1 slots
2013-10-31 16:07:43,038 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0007/attempt_20131031160444934_0007_m_000000_0. Attempting to reuse: jvm_20131031160444934_0007_m_-1232237882
2013-10-31 16:07:43,321 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_r_-541739399 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:43,330 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13242 with signal TERM. Exit code 0
2013-10-31 16:07:43,403 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_1282739064 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:43,408 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13317 with signal TERM. Exit code 0
2013-10-31 16:07:43,506 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:43,506 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:43,506 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:43,506 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_r_-541739399 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:43,526 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0007_m_-1232237882 given task: attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:43,585 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0006_m_80173135 since job job_20131031160444934_0006 is dead
2013-10-31 16:07:43,590 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group12835 with signal TERM. Exit code 0
2013-10-31 16:07:43,604 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:43,604 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:43,604 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:43,605 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_1282739064 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:07:43,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007/job.split dst=null perm=null
2013-10-31 16:07:43,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34148, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2028997783111402336_1076, duration: 126020
2013-10-31 16:07:43,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000 dst=null perm=null
2013-10-31 16:07:43,668 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34218, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2693516798230755184_1072, duration: 108361
2013-10-31 16:07:43,692 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 441 Total time for transactions(ms): 10Number of transactions batched in Syncs: 41 Number of syncs: 308 SyncTimes(ms): 11315 1492
2013-10-31 16:07:43,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:43,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:43,748 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:07:43,748 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:07:43,748 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:07:43,748 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0006_m_80173135 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:07:43,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6 dst=null perm=null
2013-10-31 16:07:43,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/part-00000 dst=null perm=null
2013-10-31 16:07:43,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6/part-00000 dst=null perm=null
2013-10-31 16:07:43,952 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47252, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2997245466678193792_1071, duration: 275806
2013-10-31 16:07:43,964 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000. blk_-8015266309344838465_1082
2013-10-31 16:07:43,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8015266309344838465_1082 src: /127.0.0.1:34220 dest: /127.0.0.1:38271
2013-10-31 16:07:43,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8015266309344838465_1082 src: /127.0.0.1:34152 dest: /127.0.0.1:50942
2013-10-31 16:07:43,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8015266309344838465_1082 src: /127.0.0.1:54258 dest: /127.0.0.1:41648
2013-10-31 16:07:43,983 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54258, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8015266309344838465_1082, duration: 1820721
2013-10-31 16:07:43,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8015266309344838465_1082 terminating
2013-10-31 16:07:43,984 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34152, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8015266309344838465_1082, duration: 2186684
2013-10-31 16:07:43,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8015266309344838465_1082 terminating
2013-10-31 16:07:43,984 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8015266309344838465_1082 size 40
2013-10-31 16:07:43,984 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34220, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0007_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8015266309344838465_1082, duration: 2325259
2013-10-31 16:07:43,985 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8015266309344838465_1082 terminating
2013-10-31 16:07:43,985 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8015266309344838465_1082 size 40
2013-10-31 16:07:43,988 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8015266309344838465_1082 size 40
2013-10-31 16:07:43,988 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:43,988 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:44,032 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0007_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:07:44,032 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000000_0 0.0%
2013-10-31 16:07:46,006 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0007_m_000000_0
2013-10-31 16:07:46,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0 dst=null perm=null
2013-10-31 16:07:46,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:46,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:46,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary/_attempt_20131031160444934_0007_m_000000_0 dst=null perm=null
2013-10-31 16:07:46,593 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000000_0 1.0% hdfs://localhost:43856/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997/part-00000:0+180
2013-10-31 16:07:46,595 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0007_m_000000_0 is done.
2013-10-31 16:07:46,595 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0007_m_000000_0 was -1
2013-10-31 16:07:46,595 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:48,002 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0007_m_000002_0
2013-10-31 16:07:48,003 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0007_m_000002_0
2013-10-31 16:07:48,003 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0007_m_000002_0 not found in cache
2013-10-31 16:07:49,010 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0007_m_000000_0' has completed task_20131031160444934_0007_m_000000 successfully.
2013-10-31 16:07:49,013 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0007_m_000001_0' to tip task_20131031160444934_0007_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:07:49,016 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0007_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:07:49,016 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0007_m_000001_0 which needs 1 slots
2013-10-31 16:07:49,016 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0007_m_000001_0 which needs 1 slots
2013-10-31 16:07:49,054 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0007_m_-769706857
2013-10-31 16:07:49,055 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0007_m_-769706857 spawned.
2013-10-31 16:07:49,058 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0007/attempt_20131031160444934_0007_m_000001_0/taskjvm.sh
2013-10-31 16:07:49,896 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0007_m_-769706857 given task: attempt_20131031160444934_0007_m_000001_0
2013-10-31 16:07:50,399 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000001_0 0.0%
2013-10-31 16:07:50,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary dst=null perm=null
2013-10-31 16:07:50,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:50,425 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_SUCCESS from client DFSClient_attempt_20131031160444934_0007_m_000001_0
2013-10-31 16:07:50,425 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0007_m_000001_0
2013-10-31 16:07:50,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:50,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:50,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8838228819783861941 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:50,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:50,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2028997783111402336 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4067490714316058154 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:50,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4067490714316058154 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4067490714316058154 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,436 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4137129478089268586 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:50,436 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4137129478089268586 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:50,436 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4137129478089268586 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:50,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0007 dst=null perm=null
2013-10-31 16:07:51,184 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_2028997783111402336_1076 blk_-4067490714316058154_1077 blk_8838228819783861941_1075 blk_4137129478089268586_1078
2013-10-31 16:07:51,185 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_2028997783111402336_1076 blk_-4067490714316058154_1077 blk_8838228819783861941_1075 blk_4137129478089268586_1078
2013-10-31 16:07:51,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4067490714316058154_1077 file build/test/data/dfs/data/data4/current/blk_-4067490714316058154 for deletion
2013-10-31 16:07:51,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data3/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:51,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4067490714316058154_1077 at file build/test/data/dfs/data/data4/current/blk_-4067490714316058154
2013-10-31 16:07:51,286 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4137129478089268586_1078 file build/test/data/dfs/data/data3/current/blk_4137129478089268586 for deletion
2013-10-31 16:07:51,286 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data3/current/blk_2028997783111402336
2013-10-31 16:07:51,286 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data4/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:51,286 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4137129478089268586_1078 at file build/test/data/dfs/data/data3/current/blk_4137129478089268586
2013-10-31 16:07:51,287 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data4/current/blk_8838228819783861941
2013-10-31 16:07:53,334 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0007_m_000001_0 0.0% cleanup
2013-10-31 16:07:53,335 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0007_m_000001_0 is done.
2013-10-31 16:07:53,336 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0007_m_000001_0 was -1
2013-10-31 16:07:53,336 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:07:53,888 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4067490714316058154_1077 file build/test/data/dfs/data/data8/current/blk_-4067490714316058154 for deletion
2013-10-31 16:07:53,888 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data7/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:53,888 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4067490714316058154_1077 at file build/test/data/dfs/data/data8/current/blk_-4067490714316058154
2013-10-31 16:07:53,888 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4137129478089268586_1078 file build/test/data/dfs/data/data7/current/blk_4137129478089268586 for deletion
2013-10-31 16:07:53,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data7/current/blk_2028997783111402336
2013-10-31 16:07:53,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data8/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:53,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4137129478089268586_1078 at file build/test/data/dfs/data/data7/current/blk_4137129478089268586
2013-10-31 16:07:53,890 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data8/current/blk_8838228819783861941
2013-10-31 16:07:54,185 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_2028997783111402336_1076 blk_8838228819783861941_1075 blk_4137129478089268586_1078
2013-10-31 16:07:54,186 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_2028997783111402336_1076 blk_-4067490714316058154_1077 blk_8838228819783861941_1075
2013-10-31 16:07:54,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data5/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:54,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4137129478089268586_1078 file build/test/data/dfs/data/data6/current/blk_4137129478089268586 for deletion
2013-10-31 16:07:54,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data5/current/blk_2028997783111402336
2013-10-31 16:07:54,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data6/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:54,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4137129478089268586_1078 at file build/test/data/dfs/data/data6/current/blk_4137129478089268586
2013-10-31 16:07:54,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data6/current/blk_8838228819783861941
2013-10-31 16:07:55,007 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 16
2013-10-31 16:07:55,026 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0007_m_000001_0' has completed task_20131031160444934_0007_m_000001 successfully.
2013-10-31 16:07:55,027 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0007 has completed successfully.
2013-10-31 16:07:55,027 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0007,submitTime=1383235654321,launchTime=1383235654919,firstMapTaskLaunchTime=1383235662998,firstJobSetupTaskLaunchTime=1383235656982,firstJobCleanupTaskLaunchTime=1383235669013,finishTime=1383235675027,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2CC911EB25C3440AB1D0D1C97C8C5190/25B9C49BB9564567ABBE62FC380614D8] lower*upper/(3/3) ...dpipesplatform/afterevery
2013-10-31 16:07:55,033 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567. blk_-3451961400852813586_1083
2013-10-31 16:07:55,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3451961400852813586_1083 src: /127.0.0.1:54263 dest: /127.0.0.1:41648
2013-10-31 16:07:55,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3451961400852813586_1083 src: /127.0.0.1:47261 dest: /127.0.0.1:47311
2013-10-31 16:07:55,041 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3451961400852813586_1083 src: /127.0.0.1:34229 dest: /127.0.0.1:38271
2013-10-31 16:07:55,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34229, dest: /127.0.0.1:38271, bytes: 11325, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3451961400852813586_1083, duration: 1752373
2013-10-31 16:07:55,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3451961400852813586_1083 terminating
2013-10-31 16:07:55,049 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47261, dest: /127.0.0.1:47311, bytes: 11325, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3451961400852813586_1083, duration: 5347831
2013-10-31 16:07:55,049 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3451961400852813586_1083 terminating
2013-10-31 16:07:55,050 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3451961400852813586_1083 size 11325
2013-10-31 16:07:55,050 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54263, dest: /127.0.0.1:41648, bytes: 11325, op: HDFS_WRITE, cliID: DFSClient_1197825700, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3451961400852813586_1083, duration: 6188624
2013-10-31 16:07:55,050 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3451961400852813586_1083 terminating
2013-10-31 16:07:55,053 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567 from client DFSClient_1197825700
2013-10-31 16:07:55,055 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_logs/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567 is closed by DFSClient_1197825700
2013-10-31 16:07:55,055 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3451961400852813586_1083 size 11325
2013-10-31 16:07:55,056 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3451961400852813586_1083 size 11325
2013-10-31 16:07:55,064 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0007_1383235654321_hadoop_%5B2CC911EB25C3440AB1D0D1C97C8C5190%2F25B9C49BB9564567 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:55,065 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0007_m_000000_0'
2013-10-31 16:07:55,065 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0007_m_000001_0'
2013-10-31 16:07:55,065 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0007_m_000002_0'
2013-10-31 16:07:55,066 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8749881692688222416 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,067 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8749881692688222416 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,067 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8749881692688222416 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,069 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0007_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:07:55,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0007 dst=null perm=null
2013-10-31 16:07:55,074 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119686764560670206 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,075 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119686764560670206 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,075 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119686764560670206 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,075 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7203448194588732562 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,075 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7203448194588732562 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,075 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7203448194588732562 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,076 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2997245466678193792 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,076 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2997245466678193792 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,076 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2997245466678193792 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7911605689_upper_EACD51C7D1E24016B2C3F15CA35644A6 dst=null perm=null
2013-10-31 16:07:55,083 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2659110045914674593 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,083 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2659110045914674593 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,083 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2659110045914674593 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,083 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6149960951356387480 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:07:55,084 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6149960951356387480 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,084 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6149960951356387480 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,084 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2693516798230755184 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:07:55,084 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2693516798230755184 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:07:55,085 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2693516798230755184 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:07:55,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8948651086_lower_99F60CF4EA3E4C35985DC60856867997 dst=null perm=null
2013-10-31 16:07:55,092 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/_temporary
2013-10-31 16:07:55,103 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:07:55,103 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0007 being deleted.
2013-10-31 16:07:55,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery dst=null perm=null
2013-10-31 16:07:55,113 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2013-10-31 16:07:55,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2013-10-31 16:07:55,117 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34162, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8015266309344838465_1082, duration: 295314
2013-10-31 16:07:55,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery dst=null perm=null
2013-10-31 16:07:55,125 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2013-10-31 16:07:55,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2013-10-31 16:07:55,129 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54268, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8015266309344838465_1082, duration: 277140
2013-10-31 16:07:55,129 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/afterevery
2013-10-31 16:07:55,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery dst=null perm=null
2013-10-31 16:07:55,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2013-10-31 16:07:55,135 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54269, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8015266309344838465_1082, duration: 270587
2013-10-31 16:07:55,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,146 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt. blk_4001027560673372033_1084
2013-10-31 16:07:55,147 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4001027560673372033_1084 src: /127.0.0.1:34234 dest: /127.0.0.1:38271
2013-10-31 16:07:55,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4001027560673372033_1084 src: /127.0.0.1:34166 dest: /127.0.0.1:50942
2013-10-31 16:07:55,150 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4001027560673372033_1084 src: /127.0.0.1:54272 dest: /127.0.0.1:41648
2013-10-31 16:07:55,152 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54272, dest: /127.0.0.1:41648, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 1047403
2013-10-31 16:07:55,152 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4001027560673372033_1084 terminating
2013-10-31 16:07:55,153 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34166, dest: /127.0.0.1:50942, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 1611473
2013-10-31 16:07:55,153 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4001027560673372033_1084 terminating
2013-10-31 16:07:55,154 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34234, dest: /127.0.0.1:38271, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 1919716
2013-10-31 16:07:55,154 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4001027560673372033_1084 terminating
2013-10-31 16:07:55,155 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4001027560673372033_1084 size 52
2013-10-31 16:07:55,157 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt from client DFSClient_1457307213
2013-10-31 16:07:55,158 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt is closed by DFSClient_1457307213
2013-10-31 16:07:55,158 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4001027560673372033_1084 size 52
2013-10-31 16:07:55,158 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4001027560673372033_1084 size 52
2013-10-31 16:07:55,331 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:07:55,331 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0007 being deleted.
2013-10-31 16:07:55,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,391 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt. blk_-1539762991683523844_1085
2013-10-31 16:07:55,393 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1539762991683523844_1085 src: /127.0.0.1:34237 dest: /127.0.0.1:38271
2013-10-31 16:07:55,394 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1539762991683523844_1085 src: /127.0.0.1:54274 dest: /127.0.0.1:41648
2013-10-31 16:07:55,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1539762991683523844_1085 src: /127.0.0.1:47272 dest: /127.0.0.1:47311
2013-10-31 16:07:55,399 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47272, dest: /127.0.0.1:47311, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 67195
2013-10-31 16:07:55,399 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1539762991683523844_1085 terminating
2013-10-31 16:07:55,400 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54274, dest: /127.0.0.1:41648, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 825817
2013-10-31 16:07:55,400 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1539762991683523844_1085 terminating
2013-10-31 16:07:55,401 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34237, dest: /127.0.0.1:38271, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 1733537
2013-10-31 16:07:55,401 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1539762991683523844_1085 terminating
2013-10-31 16:07:55,404 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1539762991683523844_1085 size 51
2013-10-31 16:07:55,405 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt from client DFSClient_1457307213
2013-10-31 16:07:55,405 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt is closed by DFSClient_1457307213
2013-10-31 16:07:55,405 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1539762991683523844_1085 size 51
2013-10-31 16:07:55,406 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1539762991683523844_1085 size 51
2013-10-31 16:07:55,431 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:07:55,432 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:07:55,468 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:07:55,468 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:07:55,468 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:07:55,468 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:07:55,469 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:07:55,469 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin"]
2013-10-31 16:07:55,469 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] parallel execution is enabled: true
2013-10-31 16:07:55,469 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting jobs: 1
2013-10-31 16:07:55,469 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] allocating threads: 1
2013-10-31 16:07:55,470 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/1) ...intocogrouplhsswappedjoin
2013-10-31 16:07:55,474 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:07:55,474 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:07:55,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:07:55,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:07:55,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,496 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar. blk_5246180269824711248_1086
2013-10-31 16:07:55,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:47273 dest: /127.0.0.1:47311
2013-10-31 16:07:55,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:34241 dest: /127.0.0.1:38271
2013-10-31 16:07:55,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:54278 dest: /127.0.0.1:41648
2013-10-31 16:07:55,510 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54278, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 6376895
2013-10-31 16:07:55,510 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5246180269824711248_1086 terminating
2013-10-31 16:07:55,511 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34241, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5246180269824711248_1086, duration: 6753377
2013-10-31 16:07:55,511 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5246180269824711248_1086 terminating
2013-10-31 16:07:55,512 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47273, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5246180269824711248_1086, duration: 7312496
2013-10-31 16:07:55,512 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5246180269824711248_1086 terminating
2013-10-31 16:07:55,515 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:55,515 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar from client DFSClient_1457307213
2013-10-31 16:07:55,515 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar is closed by DFSClient_1457307213
2013-10-31 16:07:55,516 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:55,516 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:55,522 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar. New replication is 10
2013-10-31 16:07:55,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar dst=null perm=null
2013-10-31 16:07:55,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,536 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:07:55,543 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:07:55,546 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:07:55,550 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:07:55,553 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:07:55,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:07:55,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,569 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split. New replication is 10
2013-10-31 16:07:55,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=null
2013-10-31 16:07:55,577 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split. blk_-5994389290929950108_1087
2013-10-31 16:07:55,578 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:34243 dest: /127.0.0.1:38271
2013-10-31 16:07:55,580 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:34175 dest: /127.0.0.1:50942
2013-10-31 16:07:55,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:47278 dest: /127.0.0.1:47311
2013-10-31 16:07:55,584 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5994389290929950108_1087 src: /127.0.0.1:54282 dest: /127.0.0.1:41648
2013-10-31 16:07:55,587 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54282, dest: /127.0.0.1:41648, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5994389290929950108_1087, duration: 82744
2013-10-31 16:07:55,587 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,588 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47278, dest: /127.0.0.1:47311, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5994389290929950108_1087, duration: 898482
2013-10-31 16:07:55,588 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,588 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,589 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34175, dest: /127.0.0.1:50942, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5994389290929950108_1087, duration: 1930862
2013-10-31 16:07:55,589 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,589 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,590 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34243, dest: /127.0.0.1:38271, bytes: 1728, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5994389290929950108_1087, duration: 2979880
2013-10-31 16:07:55,590 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5994389290929950108_1087 terminating
2013-10-31 16:07:55,592 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,593 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split from client DFSClient_1457307213
2013-10-31 16:07:55,593 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split is closed by DFSClient_1457307213
2013-10-31 16:07:55,594 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5994389290929950108_1087 size 1728
2013-10-31 16:07:55,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,614 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo. blk_-9066677134869793311_1088
2013-10-31 16:07:55,616 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9066677134869793311_1088 src: /127.0.0.1:47280 dest: /127.0.0.1:47311
2013-10-31 16:07:55,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9066677134869793311_1088 src: /127.0.0.1:34248 dest: /127.0.0.1:38271
2013-10-31 16:07:55,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9066677134869793311_1088 src: /127.0.0.1:54285 dest: /127.0.0.1:41648
2013-10-31 16:07:55,622 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54285, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9066677134869793311_1088, duration: 87768
2013-10-31 16:07:55,622 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9066677134869793311_1088 terminating
2013-10-31 16:07:55,623 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34248, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9066677134869793311_1088, duration: 900226
2013-10-31 16:07:55,623 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9066677134869793311_1088 terminating
2013-10-31 16:07:55,624 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47280, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9066677134869793311_1088, duration: 1861132
2013-10-31 16:07:55,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9066677134869793311_1088 terminating
2013-10-31 16:07:55,626 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9066677134869793311_1088 size 183
2013-10-31 16:07:55,626 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:07:55,627 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:07:55,627 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9066677134869793311_1088 size 183
2013-10-31 16:07:55,628 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-9066677134869793311_1088 size 183
2013-10-31 16:07:55,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:55,661 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml. blk_9146458358321234612_1089
2013-10-31 16:07:55,663 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9146458358321234612_1089 src: /127.0.0.1:34181 dest: /127.0.0.1:50942
2013-10-31 16:07:55,664 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9146458358321234612_1089 src: /127.0.0.1:47284 dest: /127.0.0.1:47311
2013-10-31 16:07:55,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9146458358321234612_1089 src: /127.0.0.1:34252 dest: /127.0.0.1:38271
2013-10-31 16:07:55,669 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34252, dest: /127.0.0.1:38271, bytes: 30306, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9146458358321234612_1089, duration: 264055
2013-10-31 16:07:55,669 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9146458358321234612_1089 terminating
2013-10-31 16:07:55,669 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47284, dest: /127.0.0.1:47311, bytes: 30306, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_9146458358321234612_1089, duration: 1019253
2013-10-31 16:07:55,670 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9146458358321234612_1089 terminating
2013-10-31 16:07:55,670 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_9146458358321234612_1089 size 30306
2013-10-31 16:07:55,671 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34181, dest: /127.0.0.1:50942, bytes: 30306, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_9146458358321234612_1089, duration: 1900452
2013-10-31 16:07:55,671 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9146458358321234612_1089 terminating
2013-10-31 16:07:55,673 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_9146458358321234612_1089 size 30306
2013-10-31 16:07:55,674 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml from client DFSClient_1457307213
2013-10-31 16:07:55,674 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml is closed by DFSClient_1457307213
2013-10-31 16:07:55,675 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_9146458358321234612_1089 size 30306
2013-10-31 16:07:55,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml dst=null perm=null
2013-10-31 16:07:55,692 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34185, bytes: 30546, op: HDFS_READ, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_9146458358321234612_1089, duration: 409722
2013-10-31 16:07:55,711 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0008: nMaps=5 nReduces=1 max=-1
2013-10-31 16:07:55,712 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0008 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:07:55,712 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0008 RESULT=SUCCESS
2013-10-31 16:07:55,712 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0008
2013-10-31 16:07:55,712 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0008
2013-10-31 16:07:55,713 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0008
2013-10-31 16:07:56,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:56,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:56,212 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml. blk_5232852608287245330_1091
2013-10-31 16:07:56,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5232852608287245330_1091 src: /127.0.0.1:34255 dest: /127.0.0.1:38271
2013-10-31 16:07:56,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5232852608287245330_1091 src: /127.0.0.1:47289 dest: /127.0.0.1:47311
2013-10-31 16:07:56,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5232852608287245330_1091 src: /127.0.0.1:54293 dest: /127.0.0.1:41648
2013-10-31 16:07:56,222 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54293, dest: /127.0.0.1:41648, bytes: 30371, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5232852608287245330_1091, duration: 751986
2013-10-31 16:07:56,222 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5232852608287245330_1091 terminating
2013-10-31 16:07:56,222 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5232852608287245330_1091 size 30371
2013-10-31 16:07:56,223 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47289, dest: /127.0.0.1:47311, bytes: 30371, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5232852608287245330_1091, duration: 1526398
2013-10-31 16:07:56,223 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5232852608287245330_1091 terminating
2013-10-31 16:07:56,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34255, dest: /127.0.0.1:38271, bytes: 30371, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5232852608287245330_1091, duration: 2891370
2013-10-31 16:07:56,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5232852608287245330_1091 terminating
2013-10-31 16:07:56,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5232852608287245330_1091 size 30371
2013-10-31 16:07:56,226 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml from client DFSClient_-1075809185
2013-10-31 16:07:56,226 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_conf.xml is closed by DFSClient_-1075809185
2013-10-31 16:07:56,227 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5232852608287245330_1091 size 30371
2013-10-31 16:07:56,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:07:56,242 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken. blk_6292824092672117012_1092
2013-10-31 16:07:56,243 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6292824092672117012_1092 src: /127.0.0.1:54294 dest: /127.0.0.1:41648
2013-10-31 16:07:56,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6292824092672117012_1092 src: /127.0.0.1:34190 dest: /127.0.0.1:50942
2013-10-31 16:07:56,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6292824092672117012_1092 src: /127.0.0.1:34260 dest: /127.0.0.1:38271
2013-10-31 16:07:56,249 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34260, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6292824092672117012_1092, duration: 63904
2013-10-31 16:07:56,250 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6292824092672117012_1092 terminating
2013-10-31 16:07:56,250 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6292824092672117012_1092 size 116
2013-10-31 16:07:56,250 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34190, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 832527
2013-10-31 16:07:56,251 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6292824092672117012_1092 terminating
2013-10-31 16:07:56,251 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54294, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6292824092672117012_1092, duration: 1757402
2013-10-31 16:07:56,252 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6292824092672117012_1092 terminating
2013-10-31 16:07:56,254 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6292824092672117012_1092 size 116
2013-10-31 16:07:56,255 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken from client DFSClient_1457307213
2013-10-31 16:07:56,255 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken is closed by DFSClient_1457307213
2013-10-31 16:07:56,256 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6292824092672117012_1092 size 116
2013-10-31 16:07:56,260 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken
2013-10-31 16:07:56,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.splitmetainfo dst=null perm=null
2013-10-31 16:07:56,265 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47294, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9066677134869793311_1088, duration: 276494
2013-10-31 16:07:56,266 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0008 = 70. Number of splits = 5
2013-10-31 16:07:56,266 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,267 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,268 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,269 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,270 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,270 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0008_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:07:56,270 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0008 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:07:56,271 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0008 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:07:56,687 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4067490714316058154_1077 file build/test/data/dfs/data/data1/current/blk_-4067490714316058154 for deletion
2013-10-31 16:07:56,687 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2028997783111402336_1076 file build/test/data/dfs/data/data2/current/blk_2028997783111402336 for deletion
2013-10-31 16:07:56,687 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4067490714316058154_1077 at file build/test/data/dfs/data/data1/current/blk_-4067490714316058154
2013-10-31 16:07:56,687 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8838228819783861941_1075 file build/test/data/dfs/data/data1/current/blk_8838228819783861941 for deletion
2013-10-31 16:07:56,687 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2028997783111402336_1076 at file build/test/data/dfs/data/data2/current/blk_2028997783111402336
2013-10-31 16:07:56,688 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8838228819783861941_1075 at file build/test/data/dfs/data/data1/current/blk_8838228819783861941
2013-10-31 16:07:57,186 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_5246180269824711248_1086 to datanode(s) 127.0.0.1:50942
2013-10-31 16:07:57,187 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_6149960951356387480_1068 blk_7203448194588732562_1068 blk_2693516798230755184_1072 blk_2997245466678193792_1071 blk_-7119686764560670206_1073 blk_2659110045914674593_1074
2013-10-31 16:07:57,187 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_6149960951356387480_1068 blk_7203448194588732562_1068 blk_2997245466678193792_1071 blk_-7119686764560670206_1073 blk_-8749881692688222416_1081 blk_2659110045914674593_1074
2013-10-31 16:07:57,287 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8749881692688222416_1081 file build/test/data/dfs/data/data3/current/blk_-8749881692688222416 for deletion
2013-10-31 16:07:57,287 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7119686764560670206_1073 file build/test/data/dfs/data/data3/current/blk_-7119686764560670206 for deletion
2013-10-31 16:07:57,287 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8749881692688222416_1081 at file build/test/data/dfs/data/data3/current/blk_-8749881692688222416
2013-10-31 16:07:57,287 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2659110045914674593_1074 file build/test/data/dfs/data/data4/current/blk_2659110045914674593 for deletion
2013-10-31 16:07:57,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7119686764560670206_1073 at file build/test/data/dfs/data/data3/current/blk_-7119686764560670206
2013-10-31 16:07:57,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2997245466678193792_1071 file build/test/data/dfs/data/data4/current/blk_2997245466678193792 for deletion
2013-10-31 16:07:57,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2659110045914674593_1074 at file build/test/data/dfs/data/data4/current/blk_2659110045914674593
2013-10-31 16:07:57,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6149960951356387480_1068 file build/test/data/dfs/data/data4/current/blk_6149960951356387480 for deletion
2013-10-31 16:07:57,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2997245466678193792_1071 at file build/test/data/dfs/data/data4/current/blk_2997245466678193792
2013-10-31 16:07:57,289 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7203448194588732562_1068 file build/test/data/dfs/data/data3/current/blk_7203448194588732562 for deletion
2013-10-31 16:07:57,289 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6149960951356387480_1068 at file build/test/data/dfs/data/data4/current/blk_6149960951356387480
2013-10-31 16:07:57,289 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7203448194588732562_1068 at file build/test/data/dfs/data/data3/current/blk_7203448194588732562
2013-10-31 16:07:57,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7119686764560670206_1073 file build/test/data/dfs/data/data6/current/blk_-7119686764560670206 for deletion
2013-10-31 16:07:57,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2659110045914674593_1074 file build/test/data/dfs/data/data5/current/blk_2659110045914674593 for deletion
2013-10-31 16:07:57,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7119686764560670206_1073 at file build/test/data/dfs/data/data6/current/blk_-7119686764560670206
2013-10-31 16:07:57,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2693516798230755184_1072 file build/test/data/dfs/data/data5/current/blk_2693516798230755184 for deletion
2013-10-31 16:07:57,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2659110045914674593_1074 at file build/test/data/dfs/data/data5/current/blk_2659110045914674593
2013-10-31 16:07:57,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2997245466678193792_1071 file build/test/data/dfs/data/data6/current/blk_2997245466678193792 for deletion
2013-10-31 16:07:57,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2693516798230755184_1072 at file build/test/data/dfs/data/data5/current/blk_2693516798230755184
2013-10-31 16:07:57,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6149960951356387480_1068 file build/test/data/dfs/data/data5/current/blk_6149960951356387480 for deletion
2013-10-31 16:07:57,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2997245466678193792_1071 at file build/test/data/dfs/data/data6/current/blk_2997245466678193792
2013-10-31 16:07:57,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7203448194588732562_1068 file build/test/data/dfs/data/data6/current/blk_7203448194588732562 for deletion
2013-10-31 16:07:57,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6149960951356387480_1068 at file build/test/data/dfs/data/data5/current/blk_6149960951356387480
2013-10-31 16:07:57,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7203448194588732562_1068 at file build/test/data/dfs/data/data6/current/blk_7203448194588732562
2013-10-31 16:07:58,029 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0008_m_000006_0' to tip task_20131031160444934_0008_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:07:58,037 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:07:58,037 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000006_0 which needs 1 slots
2013-10-31 16:07:58,037 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:07:58,038 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000006_0 which needs 1 slots
2013-10-31 16:07:58,038 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0007 being deleted.
2013-10-31 16:07:58,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken dst=null perm=null
2013-10-31 16:07:58,047 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34193, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 376001
2013-10-31 16:07:58,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml dst=null perm=null
2013-10-31 16:07:58,061 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34195, bytes: 30546, op: HDFS_READ, cliID: DFSClient_1401612830, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_9146458358321234612_1089, duration: 390529
2013-10-31 16:07:58,095 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:07:58,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar dst=null perm=null
2013-10-31 16:07:58,119 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54301, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1401612830, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 665306
2013-10-31 16:07:58,200 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_2020654016
2013-10-31 16:07:58,201 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_2020654016 spawned.
2013-10-31 16:07:58,203 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000006_0/taskjvm.sh
2013-10-31 16:07:59,417 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_2020654016 given task: attempt_20131031160444934_0008_m_000006_0
2013-10-31 16:07:59,687 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_5246180269824711248_1086 to 127.0.0.1:50942
2013-10-31 16:07:59,688 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5246180269824711248_1086 src: /127.0.0.1:34198 dest: /127.0.0.1:50942
2013-10-31 16:07:59,688 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_5246180269824711248_1086 to /127.0.0.1:50942
2013-10-31 16:07:59,690 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5246180269824711248_1086 src: /127.0.0.1:34198 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:07:59,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5246180269824711248_1086 size 238055
2013-10-31 16:07:59,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:00,067 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0007
2013-10-31 16:08:00,067 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0007_m_000001_0 not found in cache
2013-10-31 16:08:00,067 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0007_m_000000_0 not found in cache
2013-10-31 16:08:00,068 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0007 for user-log deletion with retainTimeStamp:1383322080067
2013-10-31 16:08:00,188 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_7203448194588732562_1068 blk_2693516798230755184_1072 blk_2997245466678193792_1071 blk_-8749881692688222416_1081 blk_2659110045914674593_1074
2013-10-31 16:08:00,188 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_6149960951356387480_1068 blk_2693516798230755184_1072 blk_-7119686764560670206_1073 blk_-8749881692688222416_1081
2013-10-31 16:08:00,639 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0007_m_-1232237882 since job job_20131031160444934_0007 is dead
2013-10-31 16:08:00,650 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13803 with signal TERM. Exit code 0
2013-10-31 16:08:00,813 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:00,814 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:00,814 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:00,814 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0007_m_-1232237882 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:01,410 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0007_m_-769706857 since job job_20131031160444934_0007 is dead
2013-10-31 16:08:01,419 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group13995 with signal TERM. Exit code 0
2013-10-31 16:08:01,592 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:01,593 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:01,593 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:01,593 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0007_m_-769706857 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:01,895 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3549128818189452633_1056
2013-10-31 16:08:02,689 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8749881692688222416_1081 file build/test/data/dfs/data/data1/current/blk_-8749881692688222416 for deletion
2013-10-31 16:08:02,689 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7119686764560670206_1073 file build/test/data/dfs/data/data2/current/blk_-7119686764560670206 for deletion
2013-10-31 16:08:02,689 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8749881692688222416_1081 at file build/test/data/dfs/data/data1/current/blk_-8749881692688222416
2013-10-31 16:08:02,690 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2693516798230755184_1072 file build/test/data/dfs/data/data1/current/blk_2693516798230755184 for deletion
2013-10-31 16:08:02,690 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7119686764560670206_1073 at file build/test/data/dfs/data/data2/current/blk_-7119686764560670206
2013-10-31 16:08:02,690 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2693516798230755184_1072 at file build/test/data/dfs/data/data1/current/blk_2693516798230755184
2013-10-31 16:08:02,690 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6149960951356387480_1068 file build/test/data/dfs/data/data2/current/blk_6149960951356387480 for deletion
2013-10-31 16:08:02,691 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6149960951356387480_1068 at file build/test/data/dfs/data/data2/current/blk_6149960951356387480
2013-10-31 16:08:02,887 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000006_0 0.0% setup
2013-10-31 16:08:02,889 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000006_0 is done.
2013-10-31 16:08:02,890 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000006_0 was -1
2013-10-31 16:08:02,890 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:02,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8749881692688222416_1081 file build/test/data/dfs/data/data8/current/blk_-8749881692688222416 for deletion
2013-10-31 16:08:02,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2659110045914674593_1074 file build/test/data/dfs/data/data7/current/blk_2659110045914674593 for deletion
2013-10-31 16:08:02,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8749881692688222416_1081 at file build/test/data/dfs/data/data8/current/blk_-8749881692688222416
2013-10-31 16:08:02,891 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2693516798230755184_1072 file build/test/data/dfs/data/data8/current/blk_2693516798230755184 for deletion
2013-10-31 16:08:02,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2659110045914674593_1074 at file build/test/data/dfs/data/data7/current/blk_2659110045914674593
2013-10-31 16:08:02,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2997245466678193792_1071 file build/test/data/dfs/data/data7/current/blk_2997245466678193792 for deletion
2013-10-31 16:08:02,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2693516798230755184_1072 at file build/test/data/dfs/data/data8/current/blk_2693516798230755184
2013-10-31 16:08:02,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2997245466678193792_1071 at file build/test/data/dfs/data/data7/current/blk_2997245466678193792
2013-10-31 16:08:02,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7203448194588732562_1068 file build/test/data/dfs/data/data7/current/blk_7203448194588732562 for deletion
2013-10-31 16:08:02,893 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7203448194588732562_1068 at file build/test/data/dfs/data/data7/current/blk_7203448194588732562
2013-10-31 16:08:04,044 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000006_0' has completed task_20131031160444934_0008_m_000006 successfully.
2013-10-31 16:08:04,048 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000000_0' to tip task_20131031160444934_0008_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:04,049 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000000
2013-10-31 16:08:04,050 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000001_0' to tip task_20131031160444934_0008_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:04,050 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000001
2013-10-31 16:08:04,052 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:04,053 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:08:04,053 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000000_0 which needs 1 slots
2013-10-31 16:08:04,053 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000000_0 which needs 1 slots
2013-10-31 16:08:04,054 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000001_0 which needs 1 slots
2013-10-31 16:08:04,054 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0008_m_000001_0 which needs 1 slots
2013-10-31 16:08:04,078 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000002_0' to tip task_20131031160444934_0008_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:04,078 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000002
2013-10-31 16:08:04,079 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000003_0' to tip task_20131031160444934_0008_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:04,079 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000003
2013-10-31 16:08:04,081 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:08:04,083 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:08:04,083 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000002_0 which needs 1 slots
2013-10-31 16:08:04,083 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000002_0 which needs 1 slots
2013-10-31 16:08:04,084 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000003_0 which needs 1 slots
2013-10-31 16:08:04,084 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0008_m_000003_0 which needs 1 slots
2013-10-31 16:08:04,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken dst=null perm=null
2013-10-31 16:08:04,092 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34201, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 147503
2013-10-31 16:08:04,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml dst=null perm=null
2013-10-31 16:08:04,096 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_1814522490
2013-10-31 16:08:04,097 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_1814522490 spawned.
2013-10-31 16:08:04,097 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0008/attempt_20131031160444934_0008_m_000001_0. Attempting to reuse: jvm_20131031160444934_0008_m_2020654016
2013-10-31 16:08:04,098 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34272, bytes: 30546, op: HDFS_READ, cliID: DFSClient_-2022843958, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9146458358321234612_1089, duration: 181119
2013-10-31 16:08:04,098 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000000_0/taskjvm.sh
2013-10-31 16:08:04,111 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:04,111 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0008_m_000004_0' to tip task_20131031160444934_0008_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:04,111 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0008_m_000004
2013-10-31 16:08:04,112 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:08:04,112 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000004_0 which needs 1 slots
2013-10-31 16:08:04,112 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000004_0 which needs 1 slots
2013-10-31 16:08:04,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008/jobToken dst=null perm=null
2013-10-31 16:08:04,116 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34204, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6292824092672117012_1092, duration: 124814
2013-10-31 16:08:04,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.xml dst=null perm=null
2013-10-31 16:08:04,121 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34275, bytes: 30546, op: HDFS_READ, cliID: DFSClient_1391104543, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9146458358321234612_1089, duration: 162719
2013-10-31 16:08:04,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar dst=null perm=null
2013-10-31 16:08:04,126 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54312, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2022843958, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 664283
2013-10-31 16:08:04,133 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:04,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.jar dst=null perm=null
2013-10-31 16:08:04,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54313, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1391104543, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5246180269824711248_1086, duration: 661022
2013-10-31 16:08:04,204 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_1494613078
2013-10-31 16:08:04,205 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_1494613078 spawned.
2013-10-31 16:08:04,205 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000004_0/taskjvm.sh
2013-10-31 16:08:04,248 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_-1041693586
2013-10-31 16:08:04,250 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_-1041693586 spawned.
2013-10-31 16:08:04,251 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_m_-1761742138
2013-10-31 16:08:04,253 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_m_-1761742138 spawned.
2013-10-31 16:08:04,255 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000003_0/taskjvm.sh
2013-10-31 16:08:04,255 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_m_000002_0/taskjvm.sh
2013-10-31 16:08:04,448 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_2020654016 given task: attempt_20131031160444934_0008_m_000001_0
2013-10-31 16:08:04,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=null
2013-10-31 16:08:04,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47312, bytes: 1744, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5994389290929950108_1087, duration: 170453
2013-10-31 16:08:04,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:08:04,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54316, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 150772
2013-10-31 16:08:05,457 INFO mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031160444934_0008_m_000000_0 is 1406 ms debug.
2013-10-31 16:08:05,515 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_1494613078 given task: attempt_20131031160444934_0008_m_000004_0
2013-10-31 16:08:05,518 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_1814522490 given task: attempt_20131031160444934_0008_m_000000_0
2013-10-31 16:08:05,549 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_-1041693586 given task: attempt_20131031160444934_0008_m_000003_0
2013-10-31 16:08:05,560 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_-1761742138 given task: attempt_20131031160444934_0008_m_000002_0
2013-10-31 16:08:06,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=null
2013-10-31 16:08:06,017 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47322, bytes: 712, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5994389290929950108_1087, duration: 167596
2013-10-31 16:08:06,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=null
2013-10-31 16:08:06,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54326, bytes: 1744, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5994389290929950108_1087, duration: 170382
2013-10-31 16:08:06,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=null
2013-10-31 16:08:06,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:06,057 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47324, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 130236
2013-10-31 16:08:06,058 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34292, bytes: 712, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5994389290929950108_1087, duration: 151815
2013-10-31 16:08:06,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008/job.split dst=null perm=null
2013-10-31 16:08:06,069 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34293, bytes: 1228, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5994389290929950108_1087, duration: 147284
2013-10-31 16:08:06,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:08:06,086 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34294, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 112170
2013-10-31 16:08:06,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:06,100 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47328, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 137236
2013-10-31 16:08:06,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:06,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:06,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:06,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47329, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 134093
2013-10-31 16:08:06,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:06,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:06,362 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34297, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 104086
2013-10-31 16:08:06,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:06,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:06,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54334, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 152294
2013-10-31 16:08:06,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:06,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:06,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:06,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:06,404 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34299, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 114865
2013-10-31 16:08:06,405 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34231, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 115003
2013-10-31 16:08:06,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:06,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:06,411 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34301, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 105236
2013-10-31 16:08:06,414 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47335, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0008_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 517496
2013-10-31 16:08:07,530 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:0+25
2013-10-31 16:08:07,533 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000001_0 is done.
2013-10-31 16:08:07,533 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000001_0 was 139
2013-10-31 16:08:07,533 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:08,946 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000004_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:18+1
2013-10-31 16:08:08,949 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000004_0 is done.
2013-10-31 16:08:08,949 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000004_0 was 6
2013-10-31 16:08:08,949 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:08,961 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:25+26
2013-10-31 16:08:08,963 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000000_0 is done.
2013-10-31 16:08:08,963 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000000_0 was 120
2013-10-31 16:08:08,964 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:08,984 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:9+9
2013-10-31 16:08:08,986 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000003_0 is done.
2013-10-31 16:08:08,986 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000003_0 was 264
2013-10-31 16:08:08,986 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:08,994 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+9
2013-10-31 16:08:08,995 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000002_0 is done.
2013-10-31 16:08:08,995 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000002_0 was 307
2013-10-31 16:08:08,996 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:09,053 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0008_m_000006_0
2013-10-31 16:08:09,054 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0008_m_000006_0
2013-10-31 16:08:09,054 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0008_m_000006_0 not found in cache
2013-10-31 16:08:10,060 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000000_0' has completed task_20131031160444934_0008_m_000000 successfully.
2013-10-31 16:08:10,309 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000001_0' has completed task_20131031160444934_0008_m_000001 successfully.
2013-10-31 16:08:10,311 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0008_r_000000_0' to tip task_20131031160444934_0008_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:10,312 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000004_0' has completed task_20131031160444934_0008_m_000004 successfully.
2013-10-31 16:08:10,314 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:10,315 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_r_000000_0 which needs 1 slots
2013-10-31 16:08:10,315 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_r_000000_0 which needs 1 slots
2013-10-31 16:08:10,316 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000002_0' has completed task_20131031160444934_0008_m_000002 successfully.
2013-10-31 16:08:10,319 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000003_0' has completed task_20131031160444934_0008_m_000003 successfully.
2013-10-31 16:08:10,355 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0008_r_331271179
2013-10-31 16:08:10,356 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0008_r_331271179 spawned.
2013-10-31 16:08:10,358 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0008/attempt_20131031160444934_0008_r_000000_0/taskjvm.sh
2013-10-31 16:08:11,717 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_r_331271179 given task: attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:17,391 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42163, bytes: 120, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000000_0, duration: 6115077
2013-10-31 16:08:17,405 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42163, bytes: 139, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000001_0, duration: 8054576
2013-10-31 16:08:17,421 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:46837, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000004_0, duration: 12375516
2013-10-31 16:08:17,438 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57963, bytes: 307, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000002_0, duration: 11996710
2013-10-31 16:08:17,454 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:57963, bytes: 264, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0008_m_000003_0, duration: 12450949
2013-10-31 16:08:18,204 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:18,259 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:18,312 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:18,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:18,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:18,558 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000. blk_3930024885769886491_1093
2013-10-31 16:08:18,589 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3930024885769886491_1093 src: /127.0.0.1:54344 dest: /127.0.0.1:41648
2013-10-31 16:08:18,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3930024885769886491_1093 src: /127.0.0.1:34240 dest: /127.0.0.1:50942
2013-10-31 16:08:18,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3930024885769886491_1093 src: /127.0.0.1:34310 dest: /127.0.0.1:38271
2013-10-31 16:08:18,595 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34310, dest: /127.0.0.1:38271, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0008_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3930024885769886491_1093, duration: 1880169
2013-10-31 16:08:18,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3930024885769886491_1093 terminating
2013-10-31 16:08:18,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34240, dest: /127.0.0.1:50942, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0008_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3930024885769886491_1093, duration: 3059353
2013-10-31 16:08:18,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3930024885769886491_1093 terminating
2013-10-31 16:08:18,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54344, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0008_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3930024885769886491_1093, duration: 3541650
2013-10-31 16:08:18,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3930024885769886491_1093 terminating
2013-10-31 16:08:18,601 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3930024885769886491_1093 size 592
2013-10-31 16:08:18,601 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:18,601 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:18,601 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3930024885769886491_1093 size 592
2013-10-31 16:08:18,601 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3930024885769886491_1093 size 592
2013-10-31 16:08:18,639 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0008_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:18,639 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:08:19,324 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0008_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:08:19,325 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:19,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0 dst=null perm=null
2013-10-31 16:08:19,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:19,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:19,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/_attempt_20131031160444934_0008_r_000000_0 dst=null perm=null
2013-10-31 16:08:21,252 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 1.0% reduce > reduce
2013-10-31 16:08:21,255 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_r_000000_0 1.0% reduce > reduce
2013-10-31 16:08:21,256 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_r_000000_0 is done.
2013-10-31 16:08:21,256 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_r_000000_0 was -1
2013-10-31 16:08:21,258 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:22,328 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_r_000000_0' has completed task_20131031160444934_0008_r_000000 successfully.
2013-10-31 16:08:22,333 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0008_m_000005_0' to tip task_20131031160444934_0008_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:22,336 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0008_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:08:22,337 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0008_m_000005_0 which needs 1 slots
2013-10-31 16:08:22,337 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0008_m_000005_0 which needs 1 slots
2013-10-31 16:08:22,376 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0008/attempt_20131031160444934_0008_m_000005_0. Attempting to reuse: jvm_20131031160444934_0008_m_1814522490
2013-10-31 16:08:23,029 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0008_m_1814522490 given task: attempt_20131031160444934_0008_m_000005_0
2013-10-31 16:08:23,182 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000005_0 0.0%
2013-10-31 16:08:23,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary dst=null perm=null
2013-10-31 16:08:23,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:23,199 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS from client DFSClient_attempt_20131031160444934_0008_m_000005_0
2013-10-31 16:08:23,199 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0008_m_000005_0
2013-10-31 16:08:23,204 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,204 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,204 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5246180269824711248 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5994389290929950108 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9066677134869793311 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9066677134869793311 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9066677134869793311 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9146458358321234612 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9146458358321234612 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:23,205 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9146458358321234612 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:23,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0008 dst=null perm=null
2013-10-31 16:08:24,192 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_9146458358321234612_1089 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:24,192 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_9146458358321234612_1089 blk_-9066677134869793311_1088 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:24,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9066677134869793311_1088 file build/test/data/dfs/data/data3/current/blk_-9066677134869793311 for deletion
2013-10-31 16:08:24,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data4/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:24,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9066677134869793311_1088 at file build/test/data/dfs/data/data3/current/blk_-9066677134869793311
2013-10-31 16:08:24,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data3/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:24,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data4/current/blk_-5994389290929950108
2013-10-31 16:08:24,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9146458358321234612_1089 file build/test/data/dfs/data/data4/current/blk_9146458358321234612 for deletion
2013-10-31 16:08:24,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data3/current/blk_5246180269824711248
2013-10-31 16:08:24,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9146458358321234612_1089 at file build/test/data/dfs/data/data4/current/blk_9146458358321234612
2013-10-31 16:08:26,133 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0008_m_000005_0 0.0% cleanup
2013-10-31 16:08:26,135 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0008_m_000005_0 is done.
2013-10-31 16:08:26,135 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0008_m_000005_0 was -1
2013-10-31 16:08:26,136 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:26,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data7/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:26,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data8/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:26,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data7/current/blk_-5994389290929950108
2013-10-31 16:08:26,899 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9146458358321234612_1089 file build/test/data/dfs/data/data8/current/blk_9146458358321234612 for deletion
2013-10-31 16:08:26,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data8/current/blk_5246180269824711248
2013-10-31 16:08:26,900 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9146458358321234612_1089 at file build/test/data/dfs/data/data8/current/blk_9146458358321234612
2013-10-31 16:08:27,193 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-9066677134869793311_1088 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:27,193 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_9146458358321234612_1089 blk_-9066677134869793311_1088 blk_5246180269824711248_1086 blk_-5994389290929950108_1087
2013-10-31 16:08:27,337 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:27,337 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0008_r_000000_0
2013-10-31 16:08:27,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9066677134869793311_1088 file build/test/data/dfs/data/data6/current/blk_-9066677134869793311 for deletion
2013-10-31 16:08:27,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data5/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:27,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9066677134869793311_1088 at file build/test/data/dfs/data/data6/current/blk_-9066677134869793311
2013-10-31 16:08:27,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data6/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:27,911 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data5/current/blk_-5994389290929950108
2013-10-31 16:08:27,911 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data6/current/blk_5246180269824711248
2013-10-31 16:08:28,344 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0008_m_000005_0' has completed task_20131031160444934_0008_m_000005 successfully.
2013-10-31 16:08:28,367 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0008 has completed successfully.
2013-10-31 16:08:28,368 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0008,submitTime=1383235675682,launchTime=1383235676270,firstMapTaskLaunchTime=1383235684048,firstReduceTaskLaunchTime=1383235690311,firstJobSetupTaskLaunchTime=1383235678029,firstJobCleanupTaskLaunchTime=1383235702333,finishTime=1383235708367,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[11675BC72682423490170FEA77B4B342/586B8937BCFE432FB0382FA5BC7D0906] cogrouping/(1/1) ...intocogrouplhsswappedjoin
2013-10-31 16:08:28,375 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F. blk_-9048123502738582374_1094
2013-10-31 16:08:28,376 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9048123502738582374_1094 src: /127.0.0.1:34244 dest: /127.0.0.1:50942
2013-10-31 16:08:28,379 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9048123502738582374_1094 src: /127.0.0.1:34314 dest: /127.0.0.1:38271
2013-10-31 16:08:28,381 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9048123502738582374_1094 src: /127.0.0.1:54351 dest: /127.0.0.1:41648
2013-10-31 16:08:28,386 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54351, dest: /127.0.0.1:41648, bytes: 31648, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9048123502738582374_1094, duration: 1903280
2013-10-31 16:08:28,387 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9048123502738582374_1094 terminating
2013-10-31 16:08:28,387 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34314, dest: /127.0.0.1:38271, bytes: 31648, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9048123502738582374_1094, duration: 2764854
2013-10-31 16:08:28,388 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9048123502738582374_1094 terminating
2013-10-31 16:08:28,388 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9048123502738582374_1094 size 31648
2013-10-31 16:08:28,388 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34244, dest: /127.0.0.1:50942, bytes: 31648, op: HDFS_WRITE, cliID: DFSClient_-1075809185, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9048123502738582374_1094, duration: 3879162
2013-10-31 16:08:28,388 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9048123502738582374_1094 terminating
2013-10-31 16:08:28,391 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F from client DFSClient_-1075809185
2013-10-31 16:08:28,392 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_logs/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F is closed by DFSClient_-1075809185
2013-10-31 16:08:28,392 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9048123502738582374_1094 size 31648
2013-10-31 16:08:28,393 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9048123502738582374_1094 size 31648
2013-10-31 16:08:28,401 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0008_1383235675682_hadoop_%5B11675BC72682423490170FEA77B4B342%2F586B8937BCFE432F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:28,401 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000000_0'
2013-10-31 16:08:28,402 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000001_0'
2013-10-31 16:08:28,402 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000005_0'
2013-10-31 16:08:28,402 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000006_0'
2013-10-31 16:08:28,403 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6292824092672117012 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:28,403 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_r_000000_0'
2013-10-31 16:08:28,404 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6292824092672117012 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:28,404 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6292824092672117012 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:28,405 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000002_0'
2013-10-31 16:08:28,405 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:28,405 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000003_0'
2013-10-31 16:08:28,405 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0008 being deleted.
2013-10-31 16:08:28,406 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0008_m_000004_0'
2013-10-31 16:08:28,413 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary
2013-10-31 16:08:28,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0008 dst=null perm=null
2013-10-31 16:08:28,430 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0008_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:28,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2013-10-31 16:08:28,472 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:28,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2013-10-31 16:08:28,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2013-10-31 16:08:28,478 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34317, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3930024885769886491_1093, duration: 434693
2013-10-31 16:08:28,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2013-10-31 16:08:28,495 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:28,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2013-10-31 16:08:28,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2013-10-31 16:08:28,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34249, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3930024885769886491_1093, duration: 439294
2013-10-31 16:08:28,499 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin
2013-10-31 16:08:28,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2013-10-31 16:08:28,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2013-10-31 16:08:28,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34250, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3930024885769886491_1093, duration: 407057
2013-10-31 16:08:28,531 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:08:28,532 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:08:28,570 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:08:28,570 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:08:28,571 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:08:28,571 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:08:28,571 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:08:28,572 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs"]
2013-10-31 16:08:28,572 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] parallel execution is enabled: true
2013-10-31 16:08:28,572 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting jobs: 2
2013-10-31 16:08:28,572 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] allocating threads: 2
2013-10-31 16:08:28,573 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (2/2)
2013-10-31 16:08:28,576 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:08:28,576 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:08:28,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:28,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:08:28,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,597 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar. blk_-407226121447423998_1095
2013-10-31 16:08:28,599 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:47353 dest: /127.0.0.1:47311
2013-10-31 16:08:28,601 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:54357 dest: /127.0.0.1:41648
2013-10-31 16:08:28,603 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:34253 dest: /127.0.0.1:50942
2013-10-31 16:08:28,610 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34253, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-407226121447423998_1095, duration: 4188234
2013-10-31 16:08:28,611 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-407226121447423998_1095 terminating
2013-10-31 16:08:28,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54357, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-407226121447423998_1095, duration: 5433093
2013-10-31 16:08:28,612 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-407226121447423998_1095 terminating
2013-10-31 16:08:28,612 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47353, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-407226121447423998_1095, duration: 6208098
2013-10-31 16:08:28,613 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-407226121447423998_1095 terminating
2013-10-31 16:08:28,617 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:28,617 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar from client DFSClient_1457307213
2013-10-31 16:08:28,618 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar is closed by DFSClient_1457307213
2013-10-31 16:08:28,618 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:28,619 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:28,625 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar. New replication is 10
2013-10-31 16:08:28,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar dst=null perm=null
2013-10-31 16:08:28,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,638 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:08:28,643 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:28,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:28,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,662 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split. New replication is 10
2013-10-31 16:08:28,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=null
2013-10-31 16:08:28,671 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split. blk_4549843032236031964_1096
2013-10-31 16:08:28,673 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:54359 dest: /127.0.0.1:41648
2013-10-31 16:08:28,675 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:34255 dest: /127.0.0.1:50942
2013-10-31 16:08:28,676 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:47358 dest: /127.0.0.1:47311
2013-10-31 16:08:28,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4549843032236031964_1096 src: /127.0.0.1:34326 dest: /127.0.0.1:38271
2013-10-31 16:08:28,681 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34326, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4549843032236031964_1096, duration: 89957
2013-10-31 16:08:28,682 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,682 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47358, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4549843032236031964_1096, duration: 869981
2013-10-31 16:08:28,683 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34255, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4549843032236031964_1096, duration: 1915350
2013-10-31 16:08:28,683 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,684 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54359, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4549843032236031964_1096, duration: 2705842
2013-10-31 16:08:28,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4549843032236031964_1096 terminating
2013-10-31 16:08:28,688 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,688 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split from client DFSClient_1457307213
2013-10-31 16:08:28,689 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split is closed by DFSClient_1457307213
2013-10-31 16:08:28,689 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,689 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,690 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4549843032236031964_1096 size 1732
2013-10-31 16:08:28,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,711 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo. blk_-1713806174407033772_1097
2013-10-31 16:08:28,712 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1713806174407033772_1097 src: /127.0.0.1:34327 dest: /127.0.0.1:38271
2013-10-31 16:08:28,714 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1713806174407033772_1097 src: /127.0.0.1:54364 dest: /127.0.0.1:41648
2013-10-31 16:08:28,716 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1713806174407033772_1097 src: /127.0.0.1:47362 dest: /127.0.0.1:47311
2013-10-31 16:08:28,718 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47362, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1713806174407033772_1097, duration: 60461
2013-10-31 16:08:28,719 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1713806174407033772_1097 terminating
2013-10-31 16:08:28,719 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54364, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1713806174407033772_1097, duration: 824895
2013-10-31 16:08:28,720 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1713806174407033772_1097 terminating
2013-10-31 16:08:28,720 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34327, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1713806174407033772_1097, duration: 1693295
2013-10-31 16:08:28,721 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1713806174407033772_1097 terminating
2013-10-31 16:08:28,725 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1713806174407033772_1097 size 183
2013-10-31 16:08:28,727 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1713806174407033772_1097 size 183
2013-10-31 16:08:28,728 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:08:28,728 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:08:28,728 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1713806174407033772_1097 size 183
2013-10-31 16:08:28,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:28,760 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml. blk_3851144484951187398_1098
2013-10-31 16:08:28,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3851144484951187398_1098 src: /127.0.0.1:47363 dest: /127.0.0.1:47311
2013-10-31 16:08:28,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3851144484951187398_1098 src: /127.0.0.1:54367 dest: /127.0.0.1:41648
2013-10-31 16:08:28,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3851144484951187398_1098 src: /127.0.0.1:34263 dest: /127.0.0.1:50942
2013-10-31 16:08:28,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34263, dest: /127.0.0.1:50942, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3851144484951187398_1098, duration: 978372
2013-10-31 16:08:28,768 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3851144484951187398_1098 terminating
2013-10-31 16:08:28,769 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54367, dest: /127.0.0.1:41648, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3851144484951187398_1098, duration: 933887
2013-10-31 16:08:28,769 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3851144484951187398_1098 terminating
2013-10-31 16:08:28,770 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47363, dest: /127.0.0.1:47311, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3851144484951187398_1098, duration: 2080700
2013-10-31 16:08:28,770 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3851144484951187398_1098 terminating
2013-10-31 16:08:28,772 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3851144484951187398_1098 size 28557
2013-10-31 16:08:28,772 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml from client DFSClient_1457307213
2013-10-31 16:08:28,772 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml is closed by DFSClient_1457307213
2013-10-31 16:08:28,773 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3851144484951187398_1098 size 28557
2013-10-31 16:08:28,774 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3851144484951187398_1098 size 28557
2013-10-31 16:08:28,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml dst=null perm=null
2013-10-31 16:08:28,790 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54370, bytes: 28781, op: HDFS_READ, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3851144484951187398_1098, duration: 394503
2013-10-31 16:08:28,812 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0009: nMaps=5 nReduces=0 max=-1
2013-10-31 16:08:28,812 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0009 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:08:28,812 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0009 RESULT=SUCCESS
2013-10-31 16:08:28,812 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0009
2013-10-31 16:08:28,813 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0009
2013-10-31 16:08:28,813 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0009
2013-10-31 16:08:29,698 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9066677134869793311_1088 file build/test/data/dfs/data/data2/current/blk_-9066677134869793311 for deletion
2013-10-31 16:08:29,698 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5994389290929950108_1087 file build/test/data/dfs/data/data1/current/blk_-5994389290929950108 for deletion
2013-10-31 16:08:29,698 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9066677134869793311_1088 at file build/test/data/dfs/data/data2/current/blk_-9066677134869793311
2013-10-31 16:08:29,699 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5246180269824711248_1086 file build/test/data/dfs/data/data2/current/blk_5246180269824711248 for deletion
2013-10-31 16:08:29,699 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5994389290929950108_1087 at file build/test/data/dfs/data/data1/current/blk_-5994389290929950108
2013-10-31 16:08:29,699 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9146458358321234612_1089 file build/test/data/dfs/data/data1/current/blk_9146458358321234612 for deletion
2013-10-31 16:08:29,699 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5246180269824711248_1086 at file build/test/data/dfs/data/data2/current/blk_5246180269824711248
2013-10-31 16:08:29,700 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9146458358321234612_1089 at file build/test/data/dfs/data/data1/current/blk_9146458358321234612
2013-10-31 16:08:29,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:29,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:29,874 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml. blk_1737899946981776145_1100
2013-10-31 16:08:29,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1737899946981776145_1100 src: /127.0.0.1:34266 dest: /127.0.0.1:50942
2013-10-31 16:08:29,878 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1737899946981776145_1100 src: /127.0.0.1:34336 dest: /127.0.0.1:38271
2013-10-31 16:08:29,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1737899946981776145_1100 src: /127.0.0.1:47370 dest: /127.0.0.1:47311
2013-10-31 16:08:29,883 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47370, dest: /127.0.0.1:47311, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1737899946981776145_1100, duration: 774031
2013-10-31 16:08:29,884 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1737899946981776145_1100 terminating
2013-10-31 16:08:29,884 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1737899946981776145_1100 size 28622
2013-10-31 16:08:29,884 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34336, dest: /127.0.0.1:38271, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1737899946981776145_1100, duration: 1961466
2013-10-31 16:08:29,885 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1737899946981776145_1100 terminating
2013-10-31 16:08:29,885 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34266, dest: /127.0.0.1:50942, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1737899946981776145_1100, duration: 2752496
2013-10-31 16:08:29,886 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1737899946981776145_1100 size 28622
2013-10-31 16:08:29,886 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1737899946981776145_1100 terminating
2013-10-31 16:08:29,889 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1737899946981776145_1100 size 28622
2013-10-31 16:08:29,890 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml from client DFSClient_1060990612
2013-10-31 16:08:29,890 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_conf.xml is closed by DFSClient_1060990612
2013-10-31 16:08:29,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:29,905 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken. blk_3766954078002236334_1101
2013-10-31 16:08:29,907 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3766954078002236334_1101 src: /127.0.0.1:54374 dest: /127.0.0.1:41648
2013-10-31 16:08:29,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3766954078002236334_1101 src: /127.0.0.1:47372 dest: /127.0.0.1:47311
2013-10-31 16:08:29,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3766954078002236334_1101 src: /127.0.0.1:34340 dest: /127.0.0.1:38271
2013-10-31 16:08:29,913 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34340, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3766954078002236334_1101, duration: 68268
2013-10-31 16:08:29,913 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3766954078002236334_1101 terminating
2013-10-31 16:08:29,913 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3766954078002236334_1101 size 116
2013-10-31 16:08:29,914 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47372, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3766954078002236334_1101, duration: 857830
2013-10-31 16:08:29,914 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3766954078002236334_1101 size 116
2013-10-31 16:08:29,915 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3766954078002236334_1101 terminating
2013-10-31 16:08:29,915 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54374, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3766954078002236334_1101, duration: 2116843
2013-10-31 16:08:29,916 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3766954078002236334_1101 terminating
2013-10-31 16:08:29,917 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3766954078002236334_1101 size 116
2013-10-31 16:08:29,917 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken from client DFSClient_1457307213
2013-10-31 16:08:29,918 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken is closed by DFSClient_1457307213
2013-10-31 16:08:29,923 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken
2013-10-31 16:08:29,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.splitmetainfo dst=null perm=null
2013-10-31 16:08:29,928 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54377, bytes: 187, op: HDFS_READ, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1713806174407033772_1097, duration: 367584
2013-10-31 16:08:29,929 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0009 = 19. Number of splits = 5
2013-10-31 16:08:29,929 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,932 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,933 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,933 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0009_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:29,933 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0009 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:08:29,934 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0009 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:08:30,194 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-407226121447423998_1095 to datanode(s) 127.0.0.1:38271
2013-10-31 16:08:30,194 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_6292824092672117012_1092
2013-10-31 16:08:30,194 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_6292824092672117012_1092
2013-10-31 16:08:30,911 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-407226121447423998_1095 to 127.0.0.1:38271
2013-10-31 16:08:30,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-407226121447423998_1095 src: /127.0.0.1:34343 dest: /127.0.0.1:38271
2013-10-31 16:08:30,913 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-407226121447423998_1095 to /127.0.0.1:38271
2013-10-31 16:08:30,917 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-407226121447423998_1095 src: /127.0.0.1:34343 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:08:30,918 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-407226121447423998_1095 size 238055
2013-10-31 16:08:31,408 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0009_m_000006_0' to tip task_20131031160444934_0009_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:08:31,416 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:08:31,417 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000006_0 which needs 1 slots
2013-10-31 16:08:31,417 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000006_0 which needs 1 slots
2013-10-31 16:08:31,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken dst=null perm=null
2013-10-31 16:08:31,426 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34344, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3766954078002236334_1101, duration: 295764
2013-10-31 16:08:31,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml dst=null perm=null
2013-10-31 16:08:31,436 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54382, bytes: 28781, op: HDFS_READ, cliID: DFSClient_1701655578, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3851144484951187398_1098, duration: 383880
2013-10-31 16:08:31,464 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:31,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar dst=null perm=null
2013-10-31 16:08:31,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47380, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1701655578, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-407226121447423998_1095, duration: 1620652
2013-10-31 16:08:31,591 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-825662118
2013-10-31 16:08:31,592 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-825662118 spawned.
2013-10-31 16:08:31,593 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000006_0/taskjvm.sh
2013-10-31 16:08:32,699 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6292824092672117012_1092 file build/test/data/dfs/data/data1/current/blk_6292824092672117012 for deletion
2013-10-31 16:08:32,699 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6292824092672117012_1092 at file build/test/data/dfs/data/data1/current/blk_6292824092672117012
2013-10-31 16:08:32,899 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-825662118 given task: attempt_20131031160444934_0009_m_000006_0
2013-10-31 16:08:32,901 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6292824092672117012_1092 file build/test/data/dfs/data/data7/current/blk_6292824092672117012 for deletion
2013-10-31 16:08:32,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6292824092672117012_1092 at file build/test/data/dfs/data/data7/current/blk_6292824092672117012
2013-10-31 16:08:33,194 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_6292824092672117012_1092
2013-10-31 16:08:33,404 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:33,405 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0008_m_000005_0 not found in cache
2013-10-31 16:08:33,406 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0008 for user-log deletion with retainTimeStamp:1383322113406
2013-10-31 16:08:33,406 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:33,407 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0008
2013-10-31 16:08:33,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0008 for user-log deletion with retainTimeStamp:1383322113407
2013-10-31 16:08:33,407 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0008 for user-log deletion with retainTimeStamp:1383322113407
2013-10-31 16:08:33,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:33,528 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_1494613078 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,539 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14300 with signal TERM. Exit code 0
2013-10-31 16:08:33,548 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_-1041693586 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,559 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14360 with signal TERM. Exit code 0
2013-10-31 16:08:33,560 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_-1761742138 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,574 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14361 with signal TERM. Exit code 0
2013-10-31 16:08:33,612 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_2020654016 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,617 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14157 with signal TERM. Exit code 0
2013-10-31 16:08:33,758 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,758 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,758 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:33,758 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_1494613078 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:33,773 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,773 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,773 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:33,773 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_-1761742138 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:33,781 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,781 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,781 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:33,781 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_-1041693586 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:33,790 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,791 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,791 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:33,791 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_2020654016 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:33,795 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_r_331271179 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:33,801 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14553 with signal TERM. Exit code 0
2013-10-31 16:08:33,911 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6292824092672117012_1092 file build/test/data/dfs/data/data6/current/blk_6292824092672117012 for deletion
2013-10-31 16:08:33,912 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6292824092672117012_1092 at file build/test/data/dfs/data/data6/current/blk_6292824092672117012
2013-10-31 16:08:33,973 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:33,973 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:33,973 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:33,973 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_r_331271179 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:34,173 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0008_m_1814522490 since job job_20131031160444934_0008 is dead
2013-10-31 16:08:34,183 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14301 with signal TERM. Exit code 0
2013-10-31 16:08:34,357 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:34,357 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:34,357 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:34,358 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0008_m_1814522490 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:36,349 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000006_0 0.0% setup
2013-10-31 16:08:36,352 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000006_0 is done.
2013-10-31 16:08:36,353 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000006_0 was -1
2013-10-31 16:08:36,353 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:37,423 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000006_0' has completed task_20131031160444934_0009_m_000006 successfully.
2013-10-31 16:08:37,483 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000000_0' to tip task_20131031160444934_0009_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:08:37,485 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000000
2013-10-31 16:08:37,486 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000001_0' to tip task_20131031160444934_0009_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:08:37,486 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000001
2013-10-31 16:08:37,488 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000002_0' to tip task_20131031160444934_0009_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:37,488 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000002
2013-10-31 16:08:37,489 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:37,489 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000003_0' to tip task_20131031160444934_0009_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:08:37,490 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:08:37,491 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000003
2013-10-31 16:08:37,491 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000000_0 which needs 1 slots
2013-10-31 16:08:37,491 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000000_0 which needs 1 slots
2013-10-31 16:08:37,491 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000001_0 which needs 1 slots
2013-10-31 16:08:37,492 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0009_m_000004_0' to tip task_20131031160444934_0009_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:37,492 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0009_m_000001_0 which needs 1 slots
2013-10-31 16:08:37,493 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:08:37,493 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0009_m_000004
2013-10-31 16:08:37,497 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:08:37,498 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000002_0 which needs 1 slots
2013-10-31 16:08:37,501 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000002_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:08:37,504 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000004_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000003_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000004_0 which needs 1 slots
2013-10-31 16:08:37,504 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0009_m_000003_0 which needs 1 slots
2013-10-31 16:08:37,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken dst=null perm=null
2013-10-31 16:08:37,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009/jobToken dst=null perm=null
2013-10-31 16:08:37,543 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-1184700124
2013-10-31 16:08:37,543 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-1184700124 spawned.
2013-10-31 16:08:37,544 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0009/attempt_20131031160444934_0009_m_000000_0. Attempting to reuse: jvm_20131031160444934_0009_m_-825662118
2013-10-31 16:08:37,545 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47386, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3766954078002236334_1101, duration: 136935
2013-10-31 16:08:37,545 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000001_0/taskjvm.sh
2013-10-31 16:08:37,545 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54390, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3766954078002236334_1101, duration: 134511
2013-10-31 16:08:37,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml dst=null perm=null
2013-10-31 16:08:37,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.xml dst=null perm=null
2013-10-31 16:08:37,551 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34288, bytes: 28781, op: HDFS_READ, cliID: DFSClient_189942969, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3851144484951187398_1098, duration: 220711
2013-10-31 16:08:37,551 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34289, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-1789704205, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3851144484951187398_1098, duration: 161963
2013-10-31 16:08:37,576 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:37,576 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:37,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar dst=null perm=null
2013-10-31 16:08:37,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.jar dst=null perm=null
2013-10-31 16:08:37,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34359, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1789704205, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-407226121447423998_1095, duration: 694885
2013-10-31 16:08:37,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54396, bytes: 239915, op: HDFS_READ, cliID: DFSClient_189942969, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-407226121447423998_1095, duration: 689540
2013-10-31 16:08:37,653 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-2002516500
2013-10-31 16:08:37,654 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-2002516500 spawned.
2013-10-31 16:08:37,654 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_-1792548309
2013-10-31 16:08:37,654 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_1533201895
2013-10-31 16:08:37,655 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_-1792548309 spawned.
2013-10-31 16:08:37,655 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_1533201895 spawned.
2013-10-31 16:08:37,656 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000003_0/taskjvm.sh
2013-10-31 16:08:37,656 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000002_0/taskjvm.sh
2013-10-31 16:08:37,657 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000004_0/taskjvm.sh
2013-10-31 16:08:37,906 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-825662118 given task: attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:38,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=null
2013-10-31 16:08:38,174 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34363, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4549843032236031964_1096, duration: 170304
2013-10-31 16:08:38,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:38,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:38,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:38,348 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-1184700124 given task: attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:38,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:38,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:38,501 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34295, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 143748
2013-10-31 16:08:38,504 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47398, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 105184
2013-10-31 16:08:38,511 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000. blk_-5291005561899941657_1102
2013-10-31 16:08:38,527 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5291005561899941657_1102 src: /127.0.0.1:34366 dest: /127.0.0.1:38271
2013-10-31 16:08:38,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5291005561899941657_1102 src: /127.0.0.1:47400 dest: /127.0.0.1:47311
2013-10-31 16:08:38,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5291005561899941657_1102 src: /127.0.0.1:34299 dest: /127.0.0.1:50942
2013-10-31 16:08:38,531 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34299, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5291005561899941657_1102, duration: 1391446
2013-10-31 16:08:38,531 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5291005561899941657_1102 terminating
2013-10-31 16:08:38,531 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47400, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5291005561899941657_1102, duration: 1852436
2013-10-31 16:08:38,531 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5291005561899941657_1102 terminating
2013-10-31 16:08:38,532 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34366, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5291005561899941657_1102, duration: 2227336
2013-10-31 16:08:38,532 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5291005561899941657_1102 terminating
2013-10-31 16:08:38,533 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5291005561899941657_1102 size 104
2013-10-31 16:08:38,534 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:38,535 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:38,535 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5291005561899941657_1102 size 104
2013-10-31 16:08:38,535 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5291005561899941657_1102 size 104
2013-10-31 16:08:38,575 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:38,576 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000000_0 0.0%
2013-10-31 16:08:38,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=null
2013-10-31 16:08:38,855 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54409, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4549843032236031964_1096, duration: 170943
2013-10-31 16:08:38,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:38,895 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47407, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 144543
2013-10-31 16:08:38,901 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-2002516500 given task: attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:38,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:38,930 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_1533201895 given task: attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:38,930 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_-1792548309 given task: attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:38,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:39,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:39,155 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47408, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 177456
2013-10-31 16:08:39,165 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001. blk_-5838032444424121691_1103
2013-10-31 16:08:39,189 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5838032444424121691_1103 src: /127.0.0.1:47409 dest: /127.0.0.1:47311
2013-10-31 16:08:39,190 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5838032444424121691_1103 src: /127.0.0.1:54413 dest: /127.0.0.1:41648
2013-10-31 16:08:39,191 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5838032444424121691_1103 src: /127.0.0.1:34309 dest: /127.0.0.1:50942
2013-10-31 16:08:39,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34309, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5838032444424121691_1103, duration: 1198143
2013-10-31 16:08:39,193 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5838032444424121691_1103 terminating
2013-10-31 16:08:39,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54413, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5838032444424121691_1103, duration: 1581933
2013-10-31 16:08:39,194 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5838032444424121691_1103 terminating
2013-10-31 16:08:39,194 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47409, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5838032444424121691_1103, duration: 1929748
2013-10-31 16:08:39,194 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5838032444424121691_1103 size 104
2013-10-31 16:08:39,194 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5838032444424121691_1103 terminating
2013-10-31 16:08:39,194 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5838032444424121691_1103 size 104
2013-10-31 16:08:39,195 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:39,196 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:39,197 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5838032444424121691_1103 size 104
2013-10-31 16:08:39,249 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:39,250 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000001_0 0.0%
2013-10-31 16:08:39,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=null
2013-10-31 16:08:39,408 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54418, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4549843032236031964_1096, duration: 170049
2013-10-31 16:08:39,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=null
2013-10-31 16:08:39,442 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34314, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4549843032236031964_1096, duration: 155233
2013-10-31 16:08:39,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009/job.split dst=null perm=null
2013-10-31 16:08:39,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:39,447 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47417, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 105391
2013-10-31 16:08:39,450 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47418, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4549843032236031964_1096, duration: 142082
2013-10-31 16:08:39,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:39,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:39,481 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47419, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 117374
2013-10-31 16:08:39,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:08:39,489 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34318, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 114582
2013-10-31 16:08:39,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:39,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:39,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:39,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:39,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47421, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 147204
2013-10-31 16:08:39,802 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003. blk_-5304158798441442397_1106
2013-10-31 16:08:39,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:39,824 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5304158798441442397_1106 src: /127.0.0.1:54425 dest: /127.0.0.1:41648
2013-10-31 16:08:39,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5304158798441442397_1106 src: /127.0.0.1:34321 dest: /127.0.0.1:50942
2013-10-31 16:08:39,826 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5304158798441442397_1106 src: /127.0.0.1:34391 dest: /127.0.0.1:38271
2013-10-31 16:08:39,828 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34391, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5304158798441442397_1106, duration: 1011020
2013-10-31 16:08:39,829 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5304158798441442397_1106 terminating
2013-10-31 16:08:39,829 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34321, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5304158798441442397_1106, duration: 1393764
2013-10-31 16:08:39,829 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5304158798441442397_1106 terminating
2013-10-31 16:08:39,829 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54425, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5304158798441442397_1106, duration: 1813531
2013-10-31 16:08:39,829 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5304158798441442397_1106 terminating
2013-10-31 16:08:39,831 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5304158798441442397_1106 size 104
2013-10-31 16:08:39,832 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5304158798441442397_1106 size 104
2013-10-31 16:08:39,833 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5304158798441442397_1106 size 104
2013-10-31 16:08:39,840 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:08:39,846 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,851 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,857 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,875 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:08:39,875 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:08:39,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:39,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:39,975 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47425, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 146172
2013-10-31 16:08:39,984 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002. blk_-4584120486602198512_1106
2013-10-31 16:08:40,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4584120486602198512_1106 src: /127.0.0.1:34324 dest: /127.0.0.1:50942
2013-10-31 16:08:40,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4584120486602198512_1106 src: /127.0.0.1:54430 dest: /127.0.0.1:41648
2013-10-31 16:08:40,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4584120486602198512_1106 src: /127.0.0.1:47428 dest: /127.0.0.1:47311
2013-10-31 16:08:40,011 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47428, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4584120486602198512_1106, duration: 1015031
2013-10-31 16:08:40,011 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4584120486602198512_1106 terminating
2013-10-31 16:08:40,011 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54430, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4584120486602198512_1106, duration: 1360524
2013-10-31 16:08:40,012 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4584120486602198512_1106 terminating
2013-10-31 16:08:40,012 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34324, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4584120486602198512_1106, duration: 1742258
2013-10-31 16:08:40,012 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4584120486602198512_1106 terminating
2013-10-31 16:08:40,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4584120486602198512_1106 size 104
2013-10-31 16:08:40,013 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4584120486602198512_1106 size 104
2013-10-31 16:08:40,013 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:40,013 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:40,015 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4584120486602198512_1106 size 104
2013-10-31 16:08:40,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:40,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:08:40,039 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47429, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 111811
2013-10-31 16:08:40,049 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004. blk_-4846897092815297308_1106
2013-10-31 16:08:40,058 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:40,058 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000002_0 0.0%
2013-10-31 16:08:40,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4846897092815297308_1106 src: /127.0.0.1:34328 dest: /127.0.0.1:50942
2013-10-31 16:08:40,072 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4846897092815297308_1106 src: /127.0.0.1:47431 dest: /127.0.0.1:47311
2013-10-31 16:08:40,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4846897092815297308_1106 src: /127.0.0.1:34399 dest: /127.0.0.1:38271
2013-10-31 16:08:40,075 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34399, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4846897092815297308_1106, duration: 1586555
2013-10-31 16:08:40,075 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4846897092815297308_1106 terminating
2013-10-31 16:08:40,076 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47431, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4846897092815297308_1106, duration: 1531972
2013-10-31 16:08:40,076 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4846897092815297308_1106 terminating
2013-10-31 16:08:40,076 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4846897092815297308_1106 size 104
2013-10-31 16:08:40,077 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34328, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0009_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4846897092815297308_1106, duration: 2368776
2013-10-31 16:08:40,077 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4846897092815297308_1106 terminating
2013-10-31 16:08:40,078 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:40,078 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:40,079 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4846897092815297308_1106 size 104
2013-10-31 16:08:40,080 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4846897092815297308_1106 size 104
2013-10-31 16:08:40,140 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:40,141 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000004_0 0.0%
2013-10-31 16:08:40,231 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:40,232 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:40,300 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0009_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:08:40,300 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000003_0 0.0%
2013-10-31 16:08:40,495 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000000_0
2013-10-31 16:08:40,495 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000001_0
2013-10-31 16:08:40,497 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000002_0
2013-10-31 16:08:40,498 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000003_0
2013-10-31 16:08:40,505 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0009_m_000004_0
2013-10-31 16:08:40,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0 dst=null perm=null
2013-10-31 16:08:40,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:40,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:40,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000000_0 dst=null perm=null
2013-10-31 16:08:41,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0 dst=null perm=null
2013-10-31 16:08:41,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000002_0 dst=null perm=null
2013-10-31 16:08:41,139 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:08:41,141 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000000_0 is done.
2013-10-31 16:08:41,141 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000000_0 was -1
2013-10-31 16:08:41,141 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:41,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0 dst=null perm=null
2013-10-31 16:08:41,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0/part-00004 dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000004_0 dst=null perm=null
2013-10-31 16:08:41,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0 dst=null perm=null
2013-10-31 16:08:41,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000001_0 dst=null perm=null
2013-10-31 16:08:41,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0 dst=null perm=null
2013-10-31 16:08:41,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:41,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:41,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary/_attempt_20131031160444934_0009_m_000003_0 dst=null perm=null
2013-10-31 16:08:41,776 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:08:41,778 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000001_0 is done.
2013-10-31 16:08:41,778 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000001_0 was -1
2013-10-31 16:08:41,778 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:42,334 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:08:42,336 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000003_0 is done.
2013-10-31 16:08:42,336 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000003_0 was -1
2013-10-31 16:08:42,337 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:08:42,371 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:08:42,372 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000002_0 is done.
2013-10-31 16:08:42,373 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000002_0 was -1
2013-10-31 16:08:42,373 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:42,376 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:08:42,377 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000004_0 is done.
2013-10-31 16:08:42,377 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000004_0 was -1
2013-10-31 16:08:42,377 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:42,491 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0009_m_000006_0
2013-10-31 16:08:42,491 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0009_m_000006_0
2013-10-31 16:08:42,491 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000006_0 not found in cache
2013-10-31 16:08:43,500 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000000_0' has completed task_20131031160444934_0009_m_000000 successfully.
2013-10-31 16:08:43,501 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000001_0' has completed task_20131031160444934_0009_m_000001 successfully.
2013-10-31 16:08:43,505 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000002_0' has completed task_20131031160444934_0009_m_000002 successfully.
2013-10-31 16:08:43,507 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000003_0' has completed task_20131031160444934_0009_m_000003 successfully.
2013-10-31 16:08:43,509 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000004_0' has completed task_20131031160444934_0009_m_000004 successfully.
2013-10-31 16:08:43,513 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0009_m_000005_0' to tip task_20131031160444934_0009_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:43,516 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0009_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:08:43,516 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0009_m_000005_0 which needs 1 slots
2013-10-31 16:08:43,517 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0009_m_000005_0 which needs 1 slots
2013-10-31 16:08:43,556 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0009_m_1873334364
2013-10-31 16:08:43,556 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0009_m_1873334364 spawned.
2013-10-31 16:08:43,559 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0009/attempt_20131031160444934_0009_m_000005_0/taskjvm.sh
2013-10-31 16:08:45,471 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0009_m_1873334364 given task: attempt_20131031160444934_0009_m_000005_0
2013-10-31 16:08:45,969 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000005_0 0.0%
2013-10-31 16:08:45,972 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 571 Total time for transactions(ms): 11Number of transactions batched in Syncs: 51 Number of syncs: 405 SyncTimes(ms): 13614 1883
2013-10-31 16:08:47,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_temporary dst=null perm=null
2013-10-31 16:08:47,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:47,058 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_SUCCESS from client DFSClient_attempt_20131031160444934_0009_m_000005_0
2013-10-31 16:08:47,058 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0009_m_000005_0
2013-10-31 16:08:47,066 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:47,066 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,067 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,067 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-407226121447423998 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:47,067 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,067 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:47,067 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:47,068 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4549843032236031964 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,068 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1713806174407033772 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,068 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1713806174407033772 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:47,068 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1713806174407033772 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,069 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3851144484951187398 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:08:47,069 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3851144484951187398 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:47,069 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3851144484951187398 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:47,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0009 dst=null perm=null
2013-10-31 16:08:48,197 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_3851144484951187398_1098 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:48,197 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-1713806174407033772_1097 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:48,901 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0009_m_000005_0 0.0% cleanup
2013-10-31 16:08:48,902 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0009_m_000005_0 is done.
2013-10-31 16:08:48,903 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0009_m_000005_0 was -1
2013-10-31 16:08:48,903 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:49,821 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0009_m_000005_0' has completed task_20131031160444934_0009_m_000005 successfully.
2013-10-31 16:08:50,421 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0009 has completed successfully.
2013-10-31 16:08:50,422 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0009,submitTime=1383235708780,launchTime=1383235709933,firstMapTaskLaunchTime=1383235717483,firstJobSetupTaskLaunchTime=1383235711408,firstJobCleanupTaskLaunchTime=1383235723513,finishTime=1383235730421,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2ACF4E5230894D15AF9BC4DFE6B54EB0/3821613F42004C66A17762F1A2881F4C] cogrouping/(2/2)
2013-10-31 16:08:50,428 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66. blk_5462009111682244982_1107
2013-10-31 16:08:50,430 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5462009111682244982_1107 src: /127.0.0.1:54439 dest: /127.0.0.1:41648
2013-10-31 16:08:50,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5462009111682244982_1107 src: /127.0.0.1:47437 dest: /127.0.0.1:47311
2013-10-31 16:08:50,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5462009111682244982_1107 src: /127.0.0.1:34336 dest: /127.0.0.1:50942
2013-10-31 16:08:50,439 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34336, dest: /127.0.0.1:50942, bytes: 26348, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5462009111682244982_1107, duration: 1641248
2013-10-31 16:08:50,439 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5462009111682244982_1107 terminating
2013-10-31 16:08:50,440 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47437, dest: /127.0.0.1:47311, bytes: 26348, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5462009111682244982_1107, duration: 3603203
2013-10-31 16:08:50,440 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5462009111682244982_1107 size 26348
2013-10-31 16:08:50,440 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54439, dest: /127.0.0.1:41648, bytes: 26348, op: HDFS_WRITE, cliID: DFSClient_1060990612, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5462009111682244982_1107, duration: 3122251
2013-10-31 16:08:50,440 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5462009111682244982_1107 terminating
2013-10-31 16:08:50,441 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5462009111682244982_1107 terminating
2013-10-31 16:08:50,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5462009111682244982_1107 size 26348
2013-10-31 16:08:50,444 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66 from client DFSClient_1060990612
2013-10-31 16:08:50,445 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/_logs/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66 is closed by DFSClient_1060990612
2013-10-31 16:08:50,445 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5462009111682244982_1107 size 26348
2013-10-31 16:08:50,451 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0009_1383235708780_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2F3821613F42004C66 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:50,452 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000004_0'
2013-10-31 16:08:50,453 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3766954078002236334 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:08:50,453 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000005_0'
2013-10-31 16:08:50,453 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3766954078002236334 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:08:50,454 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3766954078002236334 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:08:50,454 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:50,454 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0009 being deleted.
2013-10-31 16:08:50,457 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0009_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:08:50,458 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouplhs
2013-10-31 16:08:50,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0009 dst=null perm=null
2013-10-31 16:08:50,464 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:08:50,464 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:08:50,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:50,705 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1713806174407033772_1097 file build/test/data/dfs/data/data1/current/blk_-1713806174407033772 for deletion
2013-10-31 16:08:50,705 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data2/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:50,705 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1713806174407033772_1097 at file build/test/data/dfs/data/data1/current/blk_-1713806174407033772
2013-10-31 16:08:50,706 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data2/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:50,706 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data2/current/blk_-407226121447423998
2013-10-31 16:08:50,706 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data2/current/blk_4549843032236031964
2013-10-31 16:08:50,907 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data7/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:50,907 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3851144484951187398_1098 file build/test/data/dfs/data/data7/current/blk_3851144484951187398 for deletion
2013-10-31 16:08:50,907 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data7/current/blk_-407226121447423998
2013-10-31 16:08:50,907 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data8/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:50,908 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3851144484951187398_1098 at file build/test/data/dfs/data/data7/current/blk_3851144484951187398
2013-10-31 16:08:50,908 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data8/current/blk_4549843032236031964
2013-10-31 16:08:51,198 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_3851144484951187398_1098 blk_3766954078002236334_1101 blk_-1713806174407033772_1097 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:51,198 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_3851144484951187398_1098 blk_3766954078002236334_1101 blk_-1713806174407033772_1097 blk_4549843032236031964_1096 blk_-407226121447423998_1095
2013-10-31 16:08:51,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1713806174407033772_1097 file build/test/data/dfs/data/data4/current/blk_-1713806174407033772 for deletion
2013-10-31 16:08:51,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data4/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:51,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1713806174407033772_1097 at file build/test/data/dfs/data/data4/current/blk_-1713806174407033772
2013-10-31 16:08:51,306 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3766954078002236334_1101 file build/test/data/dfs/data/data3/current/blk_3766954078002236334 for deletion
2013-10-31 16:08:51,306 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data4/current/blk_-407226121447423998
2013-10-31 16:08:51,306 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3766954078002236334_1101 at file build/test/data/dfs/data/data3/current/blk_3766954078002236334
2013-10-31 16:08:51,306 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3851144484951187398_1098 file build/test/data/dfs/data/data3/current/blk_3851144484951187398 for deletion
2013-10-31 16:08:51,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data3/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:51,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3851144484951187398_1098 at file build/test/data/dfs/data/data3/current/blk_3851144484951187398
2013-10-31 16:08:51,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data3/current/blk_4549843032236031964
2013-10-31 16:08:51,918 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1713806174407033772_1097 file build/test/data/dfs/data/data5/current/blk_-1713806174407033772 for deletion
2013-10-31 16:08:51,918 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-407226121447423998_1095 file build/test/data/dfs/data/data5/current/blk_-407226121447423998 for deletion
2013-10-31 16:08:51,919 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1713806174407033772_1097 at file build/test/data/dfs/data/data5/current/blk_-1713806174407033772
2013-10-31 16:08:51,919 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3766954078002236334_1101 file build/test/data/dfs/data/data5/current/blk_3766954078002236334 for deletion
2013-10-31 16:08:51,919 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3851144484951187398_1098 file build/test/data/dfs/data/data6/current/blk_3851144484951187398 for deletion
2013-10-31 16:08:51,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-407226121447423998_1095 at file build/test/data/dfs/data/data5/current/blk_-407226121447423998
2013-10-31 16:08:51,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3851144484951187398_1098 at file build/test/data/dfs/data/data6/current/blk_3851144484951187398
2013-10-31 16:08:51,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4549843032236031964_1096 file build/test/data/dfs/data/data6/current/blk_4549843032236031964 for deletion
2013-10-31 16:08:51,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3766954078002236334_1101 at file build/test/data/dfs/data/data5/current/blk_3766954078002236334
2013-10-31 16:08:51,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4549843032236031964_1096 at file build/test/data/dfs/data/data6/current/blk_4549843032236031964
2013-10-31 16:08:52,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:08:52,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,177 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar. blk_-7275383232629599215_1108
2013-10-31 16:08:52,178 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:47440 dest: /127.0.0.1:47311
2013-10-31 16:08:52,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:34339 dest: /127.0.0.1:50942
2013-10-31 16:08:52,182 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:34409 dest: /127.0.0.1:38271
2013-10-31 16:08:52,190 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34409, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7275383232629599215_1108, duration: 4420288
2013-10-31 16:08:52,190 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7275383232629599215_1108 terminating
2013-10-31 16:08:52,191 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34339, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7275383232629599215_1108, duration: 5547344
2013-10-31 16:08:52,192 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7275383232629599215_1108 terminating
2013-10-31 16:08:52,192 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:52,192 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47440, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7275383232629599215_1108, duration: 6426505
2013-10-31 16:08:52,192 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7275383232629599215_1108 terminating
2013-10-31 16:08:52,194 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:52,195 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar from client DFSClient_1457307213
2013-10-31 16:08:52,195 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar is closed by DFSClient_1457307213
2013-10-31 16:08:52,196 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:52,203 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar. New replication is 10
2013-10-31 16:08:52,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar dst=null perm=null
2013-10-31 16:08:52,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,220 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:08:52,225 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:08:52,228 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:52,231 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:08:52,234 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:08:52,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:08:52,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,254 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split. New replication is 10
2013-10-31 16:08:52,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=null
2013-10-31 16:08:52,264 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split. blk_5876356830892656538_1109
2013-10-31 16:08:52,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:47443 dest: /127.0.0.1:47311
2013-10-31 16:08:52,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:34342 dest: /127.0.0.1:50942
2013-10-31 16:08:52,268 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:54448 dest: /127.0.0.1:41648
2013-10-31 16:08:52,270 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5876356830892656538_1109 src: /127.0.0.1:34413 dest: /127.0.0.1:38271
2013-10-31 16:08:52,272 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34413, dest: /127.0.0.1:38271, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5876356830892656538_1109, duration: 979664
2013-10-31 16:08:52,272 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,273 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54448, dest: /127.0.0.1:41648, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5876356830892656538_1109, duration: 435139
2013-10-31 16:08:52,273 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,274 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34342, dest: /127.0.0.1:50942, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5876356830892656538_1109, duration: 2208970
2013-10-31 16:08:52,274 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,274 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47443, dest: /127.0.0.1:47311, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5876356830892656538_1109, duration: 1642149
2013-10-31 16:08:52,274 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,274 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5876356830892656538_1109 terminating
2013-10-31 16:08:52,277 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,277 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split from client DFSClient_1457307213
2013-10-31 16:08:52,278 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split is closed by DFSClient_1457307213
2013-10-31 16:08:52,278 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,278 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5876356830892656538_1109 size 1722
2013-10-31 16:08:52,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,301 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo. blk_2593862758334192524_1110
2013-10-31 16:08:52,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2593862758334192524_1110 src: /127.0.0.1:34345 dest: /127.0.0.1:50942
2013-10-31 16:08:52,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2593862758334192524_1110 src: /127.0.0.1:54451 dest: /127.0.0.1:41648
2013-10-31 16:08:52,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2593862758334192524_1110 src: /127.0.0.1:47449 dest: /127.0.0.1:47311
2013-10-31 16:08:52,308 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47449, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2593862758334192524_1110, duration: 66531
2013-10-31 16:08:52,308 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2593862758334192524_1110 terminating
2013-10-31 16:08:52,308 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54451, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2593862758334192524_1110, duration: 797784
2013-10-31 16:08:52,309 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2593862758334192524_1110 terminating
2013-10-31 16:08:52,309 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34345, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2593862758334192524_1110, duration: 1632381
2013-10-31 16:08:52,309 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2593862758334192524_1110 size 183
2013-10-31 16:08:52,310 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2593862758334192524_1110 terminating
2013-10-31 16:08:52,311 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2593862758334192524_1110 size 183
2013-10-31 16:08:52,316 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:08:52,316 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:08:52,316 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2593862758334192524_1110 size 183
2013-10-31 16:08:52,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,346 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml. blk_-83841722562286388_1111
2013-10-31 16:08:52,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-83841722562286388_1111 src: /127.0.0.1:34348 dest: /127.0.0.1:50942
2013-10-31 16:08:52,349 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-83841722562286388_1111 src: /127.0.0.1:47451 dest: /127.0.0.1:47311
2013-10-31 16:08:52,351 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-83841722562286388_1111 src: /127.0.0.1:54455 dest: /127.0.0.1:41648
2013-10-31 16:08:52,354 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54455, dest: /127.0.0.1:41648, bytes: 29836, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 258515
2013-10-31 16:08:52,354 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-83841722562286388_1111 terminating
2013-10-31 16:08:52,355 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47451, dest: /127.0.0.1:47311, bytes: 29836, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-83841722562286388_1111, duration: 1048790
2013-10-31 16:08:52,355 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-83841722562286388_1111 terminating
2013-10-31 16:08:52,355 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-83841722562286388_1111 size 29836
2013-10-31 16:08:52,356 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34348, dest: /127.0.0.1:50942, bytes: 29836, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-83841722562286388_1111, duration: 2001229
2013-10-31 16:08:52,356 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-83841722562286388_1111 size 29836
2013-10-31 16:08:52,356 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-83841722562286388_1111 terminating
2013-10-31 16:08:52,358 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml from client DFSClient_1457307213
2013-10-31 16:08:52,358 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml is closed by DFSClient_1457307213
2013-10-31 16:08:52,360 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-83841722562286388_1111 size 29836
2013-10-31 16:08:52,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml dst=null perm=null
2013-10-31 16:08:52,376 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54457, bytes: 30072, op: HDFS_READ, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 397366
2013-10-31 16:08:52,393 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0010: nMaps=5 nReduces=1 max=-1
2013-10-31 16:08:52,394 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0010 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:08:52,394 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0010 RESULT=SUCCESS
2013-10-31 16:08:52,394 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0010
2013-10-31 16:08:52,394 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0010
2013-10-31 16:08:52,395 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0010
2013-10-31 16:08:52,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:52,427 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml. blk_-7595975142248415961_1113
2013-10-31 16:08:52,429 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7595975142248415961_1113 src: /127.0.0.1:47455 dest: /127.0.0.1:47311
2013-10-31 16:08:52,431 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7595975142248415961_1113 src: /127.0.0.1:34423 dest: /127.0.0.1:38271
2013-10-31 16:08:52,432 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7595975142248415961_1113 src: /127.0.0.1:54460 dest: /127.0.0.1:41648
2013-10-31 16:08:52,437 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54460, dest: /127.0.0.1:41648, bytes: 29901, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7595975142248415961_1113, duration: 1181329
2013-10-31 16:08:52,437 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7595975142248415961_1113 terminating
2013-10-31 16:08:52,437 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34423, dest: /127.0.0.1:38271, bytes: 29901, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7595975142248415961_1113, duration: 1859085
2013-10-31 16:08:52,438 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7595975142248415961_1113 terminating
2013-10-31 16:08:52,438 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47455, dest: /127.0.0.1:47311, bytes: 29901, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7595975142248415961_1113, duration: 2269501
2013-10-31 16:08:52,439 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7595975142248415961_1113 terminating
2013-10-31 16:08:52,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7595975142248415961_1113 size 29901
2013-10-31 16:08:52,442 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7595975142248415961_1113 size 29901
2013-10-31 16:08:52,443 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7595975142248415961_1113 size 29901
2013-10-31 16:08:52,514 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000000_0'
2013-10-31 16:08:52,514 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000001_0'
2013-10-31 16:08:52,514 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000006_0'
2013-10-31 16:08:52,518 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000002_0'
2013-10-31 16:08:52,518 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0009_m_000003_0'
2013-10-31 16:08:52,841 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml from client DFSClient_1820866866
2013-10-31 16:08:52,842 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_conf.xml is closed by DFSClient_1820866866
2013-10-31 16:08:53,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:08:53,378 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken. blk_1633528743412317819_1114
2013-10-31 16:08:53,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1633528743412317819_1114 src: /127.0.0.1:34356 dest: /127.0.0.1:50942
2013-10-31 16:08:53,381 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1633528743412317819_1114 src: /127.0.0.1:54462 dest: /127.0.0.1:41648
2013-10-31 16:08:53,383 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1633528743412317819_1114 src: /127.0.0.1:34427 dest: /127.0.0.1:38271
2013-10-31 16:08:53,386 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34427, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1633528743412317819_1114, duration: 90703
2013-10-31 16:08:53,386 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1633528743412317819_1114 terminating
2013-10-31 16:08:53,386 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1633528743412317819_1114 size 116
2013-10-31 16:08:53,387 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54462, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1633528743412317819_1114, duration: 973980
2013-10-31 16:08:53,387 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1633528743412317819_1114 terminating
2013-10-31 16:08:53,388 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34356, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1633528743412317819_1114, duration: 2128318
2013-10-31 16:08:53,388 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1633528743412317819_1114 terminating
2013-10-31 16:08:53,390 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken from client DFSClient_1457307213
2013-10-31 16:08:53,391 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken is closed by DFSClient_1457307213
2013-10-31 16:08:53,391 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1633528743412317819_1114 size 116
2013-10-31 16:08:53,392 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1633528743412317819_1114 size 116
2013-10-31 16:08:53,398 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken
2013-10-31 16:08:53,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.splitmetainfo dst=null perm=null
2013-10-31 16:08:53,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47461, bytes: 187, op: HDFS_READ, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2593862758334192524_1110, duration: 275515
2013-10-31 16:08:53,404 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0010 = 103. Number of splits = 5
2013-10-31 16:08:53,404 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,404 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,404 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,405 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,406 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,407 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0010_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:08:53,408 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0010 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:08:53,408 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0010 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:08:53,475 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0010_m_000006_0' to tip task_20131031160444934_0010_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:53,488 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:08:53,488 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000006_0 which needs 1 slots
2013-10-31 16:08:53,491 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000006_0 which needs 1 slots
2013-10-31 16:08:53,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken dst=null perm=null
2013-10-31 16:08:53,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54465, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1633528743412317819_1114, duration: 302011
2013-10-31 16:08:53,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml dst=null perm=null
2013-10-31 16:08:53,509 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54467, bytes: 30072, op: HDFS_READ, cliID: DFSClient_2117278007, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 386580
2013-10-31 16:08:53,541 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:53,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar dst=null perm=null
2013-10-31 16:08:53,566 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34432, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2117278007, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7275383232629599215_1108, duration: 1350968
2013-10-31 16:08:53,676 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0009_m_1873334364
2013-10-31 16:08:53,683 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15257 with signal TERM. Exit code 0
2013-10-31 16:08:53,683 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_103663412
2013-10-31 16:08:53,684 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_103663412 spawned.
2013-10-31 16:08:53,685 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000006_0/taskjvm.sh
2013-10-31 16:08:53,971 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0009_m_1873334364
2013-10-31 16:08:54,199 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-7275383232629599215_1108 to datanode(s) 127.0.0.1:41648
2013-10-31 16:08:54,199 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_3766954078002236334_1101
2013-10-31 16:08:54,289 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:54,290 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:54,290 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:54,290 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_1873334364 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:54,918 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_103663412 given task: attempt_20131031160444934_0010_m_000006_0
2013-10-31 16:08:55,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:08:55,454 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:55,454 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000004_0 not found in cache
2013-10-31 16:08:55,454 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000005_0 not found in cache
2013-10-31 16:08:55,455 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0009 for user-log deletion with retainTimeStamp:1383322135454
2013-10-31 16:08:56,428 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-1792548309 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:56,441 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15019 with signal TERM. Exit code 0
2013-10-31 16:08:56,648 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:56,648 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:56,649 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:56,650 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-1792548309 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:56,707 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-7275383232629599215_1108 to 127.0.0.1:41648
2013-10-31 16:08:56,707 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3766954078002236334_1101 file build/test/data/dfs/data/data1/current/blk_3766954078002236334 for deletion
2013-10-31 16:08:56,708 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3766954078002236334_1101 at file build/test/data/dfs/data/data1/current/blk_3766954078002236334
2013-10-31 16:08:56,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275383232629599215_1108 src: /127.0.0.1:54472 dest: /127.0.0.1:41648
2013-10-31 16:08:56,709 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-7275383232629599215_1108 to /127.0.0.1:41648
2013-10-31 16:08:56,712 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-7275383232629599215_1108 src: /127.0.0.1:54472 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:08:56,715 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7275383232629599215_1108 size 238055
2013-10-31 16:08:57,515 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:57,515 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000000_0 not found in cache
2013-10-31 16:08:57,516 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000001_0 not found in cache
2013-10-31 16:08:57,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0009 for user-log deletion with retainTimeStamp:1383322137516
2013-10-31 16:08:57,519 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0009
2013-10-31 16:08:57,519 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000003_0 not found in cache
2013-10-31 16:08:57,520 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0009_m_000002_0 not found in cache
2013-10-31 16:08:57,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0009 for user-log deletion with retainTimeStamp:1383322137520
2013-10-31 16:08:57,911 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-2002516500 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:57,920 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14987 with signal TERM. Exit code 0
2013-10-31 16:08:57,927 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_1533201895 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:57,937 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15020 with signal TERM. Exit code 0
2013-10-31 16:08:58,114 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:58,114 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:58,114 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:58,115 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-2002516500 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:58,116 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:58,116 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:58,116 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:58,116 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_1533201895 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:58,189 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-825662118 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:58,198 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14753 with signal TERM. Exit code 0
2013-10-31 16:08:58,333 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000006_0 0.0% setup
2013-10-31 16:08:58,335 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000006_0 is done.
2013-10-31 16:08:58,335 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000006_0 was -1
2013-10-31 16:08:58,335 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:08:58,379 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:58,379 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:58,379 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:58,379 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-825662118 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:08:58,866 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0009_m_-1184700124 since job job_20131031160444934_0009 is dead
2013-10-31 16:08:58,874 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group14919 with signal TERM. Exit code 0
2013-10-31 16:08:59,138 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:08:59,139 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:08:59,139 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:08:59,140 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0009_m_-1184700124 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:08:59,493 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000006_0' has completed task_20131031160444934_0010_m_000006 successfully.
2013-10-31 16:08:59,497 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000000_0' to tip task_20131031160444934_0010_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:59,498 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000000
2013-10-31 16:08:59,498 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000001_0' to tip task_20131031160444934_0010_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:08:59,499 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000001
2013-10-31 16:08:59,501 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000002_0' to tip task_20131031160444934_0010_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:59,502 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:08:59,502 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000002
2013-10-31 16:08:59,503 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:08:59,503 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000003_0' to tip task_20131031160444934_0010_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:08:59,503 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000000_0 which needs 1 slots
2013-10-31 16:08:59,503 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000000_0 which needs 1 slots
2013-10-31 16:08:59,504 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000003
2013-10-31 16:08:59,504 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000001_0 which needs 1 slots
2013-10-31 16:08:59,504 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0010_m_000001_0 which needs 1 slots
2013-10-31 16:08:59,508 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:08:59,512 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:08:59,512 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000002_0 which needs 1 slots
2013-10-31 16:08:59,513 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000002_0 which needs 1 slots
2013-10-31 16:08:59,514 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000003_0 which needs 1 slots
2013-10-31 16:08:59,514 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0010_m_000003_0 which needs 1 slots
2013-10-31 16:08:59,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken dst=null perm=null
2013-10-31 16:08:59,523 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54473, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1633528743412317819_1114, duration: 294267
2013-10-31 16:08:59,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml dst=null perm=null
2013-10-31 16:08:59,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54475, bytes: 30072, op: HDFS_READ, cliID: DFSClient_1700631364, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-83841722562286388_1111, duration: 380486
2013-10-31 16:08:59,542 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_970588561
2013-10-31 16:08:59,543 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_970588561 spawned.
2013-10-31 16:08:59,544 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0010/attempt_20131031160444934_0010_m_000001_0. Attempting to reuse: jvm_20131031160444934_0010_m_103663412
2013-10-31 16:08:59,544 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000000_0/taskjvm.sh
2013-10-31 16:08:59,624 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:08:59,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar dst=null perm=null
2013-10-31 16:08:59,685 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47473, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1700631364, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7275383232629599215_1108, duration: 1645563
2013-10-31 16:08:59,759 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_2036878026
2013-10-31 16:08:59,759 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_2036878026 spawned.
2013-10-31 16:08:59,761 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000002_0/taskjvm.sh
2013-10-31 16:08:59,762 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_-1794027183
2013-10-31 16:08:59,763 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_-1794027183 spawned.
2013-10-31 16:08:59,764 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000003_0/taskjvm.sh
2013-10-31 16:08:59,893 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_103663412 given task: attempt_20131031160444934_0010_m_000001_0
2013-10-31 16:09:00,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=null
2013-10-31 16:09:00,009 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47475, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5876356830892656538_1109, duration: 174744
2013-10-31 16:09:00,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:09:00,061 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34443, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 125649
2013-10-31 16:09:00,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=null
2013-10-31 16:09:00,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000 dst=null perm=null
2013-10-31 16:09:00,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001 dst=null perm=null
2013-10-31 16:09:00,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002 dst=null perm=null
2013-10-31 16:09:00,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003 dst=null perm=null
2013-10-31 16:09:00,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004 dst=null perm=null
2013-10-31 16:09:00,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000 dst=null perm=null
2013-10-31 16:09:00,382 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47478, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5291005561899941657_1102, duration: 134344
2013-10-31 16:09:00,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001 dst=null perm=null
2013-10-31 16:09:00,390 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47479, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5838032444424121691_1103, duration: 133794
2013-10-31 16:09:00,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002 dst=null perm=null
2013-10-31 16:09:00,394 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34378, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4584120486602198512_1106, duration: 103685
2013-10-31 16:09:00,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003 dst=null perm=null
2013-10-31 16:09:00,396 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54484, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5304158798441442397_1106, duration: 100605
2013-10-31 16:09:00,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004 dst=null perm=null
2013-10-31 16:09:00,399 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34449, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4846897092815297308_1106, duration: 100665
2013-10-31 16:09:00,444 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_970588561 given task: attempt_20131031160444934_0010_m_000000_0
2013-10-31 16:09:00,823 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_2036878026 given task: attempt_20131031160444934_0010_m_000002_0
2013-10-31 16:09:00,896 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_-1794027183 given task: attempt_20131031160444934_0010_m_000003_0
2013-10-31 16:09:00,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=null
2013-10-31 16:09:00,955 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47487, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5876356830892656538_1109, duration: 168077
2013-10-31 16:09:00,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:09:01,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=null
2013-10-31 16:09:01,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000 dst=null perm=null
2013-10-31 16:09:01,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001 dst=null perm=null
2013-10-31 16:09:01,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002 dst=null perm=null
2013-10-31 16:09:01,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003 dst=null perm=null
2013-10-31 16:09:01,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004 dst=null perm=null
2013-10-31 16:09:01,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00000 dst=null perm=null
2013-10-31 16:09:01,317 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47489, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5291005561899941657_1102, duration: 125372
2013-10-31 16:09:01,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00001 dst=null perm=null
2013-10-31 16:09:01,328 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54493, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5838032444424121691_1103, duration: 130146
2013-10-31 16:09:01,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00002 dst=null perm=null
2013-10-31 16:09:01,333 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34389, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4584120486602198512_1106, duration: 97322
2013-10-31 16:09:01,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00003 dst=null perm=null
2013-10-31 16:09:01,337 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54495, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5304158798441442397_1106, duration: 112011
2013-10-31 16:09:01,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43/part-00004 dst=null perm=null
2013-10-31 16:09:01,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34391, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4846897092815297308_1106, duration: 101440
2013-10-31 16:09:01,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54497, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 101923
2013-10-31 16:09:01,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=null
2013-10-31 16:09:01,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34463, bytes: 1222, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5876356830892656538_1109, duration: 156919
2013-10-31 16:09:01,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:09:01,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=null
2013-10-31 16:09:01,456 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34395, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5876356830892656538_1109, duration: 184573
2013-10-31 16:09:01,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:09:01,496 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47498, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 123991
2013-10-31 16:09:01,523 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0010_m_000004_0' to tip task_20131031160444934_0010_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:01,524 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0010_m_000004
2013-10-31 16:09:01,526 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:09:01,526 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000004_0 which needs 1 slots
2013-10-31 16:09:01,526 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000004_0 which needs 1 slots
2013-10-31 16:09:01,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010/jobToken dst=null perm=null
2013-10-31 16:09:01,530 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34397, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1633528743412317819_1114, duration: 116591
2013-10-31 16:09:01,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.xml dst=null perm=null
2013-10-31 16:09:01,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47501, bytes: 30072, op: HDFS_READ, cliID: DFSClient_-893266544, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-83841722562286388_1111, duration: 155537
2013-10-31 16:09:01,547 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:01,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.jar dst=null perm=null
2013-10-31 16:09:01,562 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34469, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-893266544, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7275383232629599215_1108, duration: 665040
2013-10-31 16:09:01,615 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_m_-616353992
2013-10-31 16:09:01,616 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_m_-616353992 spawned.
2013-10-31 16:09:01,617 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_m_000004_0/taskjvm.sh
2013-10-31 16:09:02,297 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34470, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 130998
2013-10-31 16:09:02,971 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:09:02,973 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000001_0 is done.
2013-10-31 16:09:02,974 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000001_0 was 264
2013-10-31 16:09:02,974 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:03,135 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_-616353992 given task: attempt_20131031160444934_0010_m_000004_0
2013-10-31 16:09:03,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010/job.split dst=null perm=null
2013-10-31 16:09:03,648 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34473, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5876356830892656538_1109, duration: 164221
2013-10-31 16:09:03,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:09:03,689 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54510, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0010_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 245942
2013-10-31 16:09:03,879 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:09:03,880 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000000_0 is done.
2013-10-31 16:09:03,881 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000000_0 was 307
2013-10-31 16:09:03,881 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:04,302 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:0+17
2013-10-31 16:09:04,305 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000002_0 is done.
2013-10-31 16:09:04,305 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000002_0 was 101
2013-10-31 16:09:04,305 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:04,382 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:17+17
2013-10-31 16:09:04,384 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000003_0 is done.
2013-10-31 16:09:04,384 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000003_0 was 82
2013-10-31 16:09:04,385 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:04,503 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0010_m_000006_0
2013-10-31 16:09:04,504 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0010_m_000006_0
2013-10-31 16:09:04,504 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0010_m_000006_0 not found in cache
2013-10-31 16:09:05,508 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000000_0' has completed task_20131031160444934_0010_m_000000 successfully.
2013-10-31 16:09:05,510 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000001_0' has completed task_20131031160444934_0010_m_000001 successfully.
2013-10-31 16:09:05,512 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0010_r_000000_0' to tip task_20131031160444934_0010_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:09:05,514 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:09:05,515 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_r_000000_0 which needs 1 slots
2013-10-31 16:09:05,515 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_r_000000_0 which needs 1 slots
2013-10-31 16:09:05,515 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000002_0' has completed task_20131031160444934_0010_m_000002 successfully.
2013-10-31 16:09:05,519 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000003_0' has completed task_20131031160444934_0010_m_000003 successfully.
2013-10-31 16:09:05,554 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0010_r_266027598
2013-10-31 16:09:05,555 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0010_r_266027598 spawned.
2013-10-31 16:09:05,558 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0010/attempt_20131031160444934_0010_r_000000_0/taskjvm.sh
2013-10-31 16:09:06,553 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:34+17
2013-10-31 16:09:06,557 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000004_0 is done.
2013-10-31 16:09:06,557 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000004_0 was 82
2013-10-31 16:09:06,557 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:06,733 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_r_266027598 given task: attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:07,532 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000004_0' has completed task_20131031160444934_0010_m_000004 successfully.
2013-10-31 16:09:12,422 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47008, bytes: 307, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000000_0, duration: 9460221
2013-10-31 16:09:12,447 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47008, bytes: 264, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000001_0, duration: 11572434
2013-10-31 16:09:12,465 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42336, bytes: 101, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000002_0, duration: 12379117
2013-10-31 16:09:12,480 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42336, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000003_0, duration: 11451142
2013-10-31 16:09:12,501 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46203, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0010_m_000004_0, duration: 15473339
2013-10-31 16:09:13,221 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:13,285 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:13,348 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:13,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:13,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:13,608 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000. blk_3690515878603194838_1115
2013-10-31 16:09:13,631 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3690515878603194838_1115 src: /127.0.0.1:47513 dest: /127.0.0.1:47311
2013-10-31 16:09:13,632 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3690515878603194838_1115 src: /127.0.0.1:54517 dest: /127.0.0.1:41648
2013-10-31 16:09:13,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3690515878603194838_1115 src: /127.0.0.1:34482 dest: /127.0.0.1:38271
2013-10-31 16:09:13,636 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34482, dest: /127.0.0.1:38271, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0010_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 2088814
2013-10-31 16:09:13,636 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3690515878603194838_1115 terminating
2013-10-31 16:09:13,636 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3690515878603194838_1115 size 592
2013-10-31 16:09:13,636 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54517, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0010_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3690515878603194838_1115, duration: 2756664
2013-10-31 16:09:13,637 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3690515878603194838_1115 terminating
2013-10-31 16:09:13,637 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47513, dest: /127.0.0.1:47311, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0010_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3690515878603194838_1115, duration: 3199784
2013-10-31 16:09:13,637 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3690515878603194838_1115 size 592
2013-10-31 16:09:13,637 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3690515878603194838_1115 terminating
2013-10-31 16:09:13,638 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3690515878603194838_1115 size 592
2013-10-31 16:09:13,640 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:13,640 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:13,678 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0010_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:13,678 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:09:14,524 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0010_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:51957
2013-10-31 16:09:14,528 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:14,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0 dst=null perm=null
2013-10-31 16:09:14,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:14,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:14,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/_attempt_20131031160444934_0010_r_000000_0 dst=null perm=null
2013-10-31 16:09:16,275 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 1.0% reduce > reduce
2013-10-31 16:09:16,278 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_r_000000_0 1.0% reduce > reduce
2013-10-31 16:09:16,279 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_r_000000_0 is done.
2013-10-31 16:09:16,279 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_r_000000_0 was -1
2013-10-31 16:09:16,280 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:17,532 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_r_000000_0' has completed task_20131031160444934_0010_r_000000 successfully.
2013-10-31 16:09:17,537 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0010_m_000005_0' to tip task_20131031160444934_0010_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:09:17,540 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0010_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:09:17,541 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0010_m_000005_0 which needs 1 slots
2013-10-31 16:09:17,541 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0010_m_000005_0 which needs 1 slots
2013-10-31 16:09:17,579 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0010/attempt_20131031160444934_0010_m_000005_0. Attempting to reuse: jvm_20131031160444934_0010_m_970588561
2013-10-31 16:09:17,954 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0010_m_970588561 given task: attempt_20131031160444934_0010_m_000005_0
2013-10-31 16:09:18,065 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000005_0 0.0%
2013-10-31 16:09:18,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary dst=null perm=null
2013-10-31 16:09:18,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:18,091 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS from client DFSClient_attempt_20131031160444934_0010_m_000005_0
2013-10-31 16:09:18,091 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0010_m_000005_0
2013-10-31 16:09:18,099 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,099 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,100 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:18,100 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275383232629599215 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,100 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,100 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,101 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,101 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5876356830892656538 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:18,101 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2593862758334192524 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,101 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2593862758334192524 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,101 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2593862758334192524 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,102 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-83841722562286388 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:18,102 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-83841722562286388 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:18,102 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-83841722562286388 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:18,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0010 dst=null perm=null
2013-10-31 16:09:18,203 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_5876356830892656538_1109 blk_2593862758334192524_1110 blk_-83841722562286388_1111 blk_-7275383232629599215_1108
2013-10-31 16:09:18,203 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_5876356830892656538_1109 blk_2593862758334192524_1110 blk_-83841722562286388_1111 blk_-7275383232629599215_1108
2013-10-31 16:09:18,314 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data3/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:18,315 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-83841722562286388_1111 file build/test/data/dfs/data/data4/current/blk_-83841722562286388 for deletion
2013-10-31 16:09:18,315 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2593862758334192524_1110 file build/test/data/dfs/data/data3/current/blk_2593862758334192524 for deletion
2013-10-31 16:09:18,315 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-83841722562286388_1111 at file build/test/data/dfs/data/data4/current/blk_-83841722562286388
2013-10-31 16:09:18,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data4/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:18,315 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data3/current/blk_-7275383232629599215
2013-10-31 16:09:18,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data4/current/blk_5876356830892656538
2013-10-31 16:09:18,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2593862758334192524_1110 at file build/test/data/dfs/data/data3/current/blk_2593862758334192524
2013-10-31 16:09:18,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data5/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:18,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-83841722562286388_1111 file build/test/data/dfs/data/data6/current/blk_-83841722562286388 for deletion
2013-10-31 16:09:18,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data5/current/blk_-7275383232629599215
2013-10-31 16:09:18,928 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-83841722562286388_1111 at file build/test/data/dfs/data/data6/current/blk_-83841722562286388
2013-10-31 16:09:18,928 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2593862758334192524_1110 file build/test/data/dfs/data/data5/current/blk_2593862758334192524 for deletion
2013-10-31 16:09:18,928 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data6/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:18,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2593862758334192524_1110 at file build/test/data/dfs/data/data5/current/blk_2593862758334192524
2013-10-31 16:09:18,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data6/current/blk_5876356830892656538
2013-10-31 16:09:20,010 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 40
2013-10-31 16:09:21,039 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0010_m_000005_0 0.0% cleanup
2013-10-31 16:09:21,040 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0010_m_000005_0 is done.
2013-10-31 16:09:21,041 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0010_m_000005_0 was -1
2013-10-31 16:09:21,041 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:21,204 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_5876356830892656538_1109 blk_2593862758334192524_1110 blk_-83841722562286388_1111 blk_-7275383232629599215_1108
2013-10-31 16:09:21,204 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_5876356830892656538_1109 blk_-7275383232629599215_1108
2013-10-31 16:09:22,541 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:22,541 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0010_r_000000_0
2013-10-31 16:09:23,548 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0010_m_000005_0' has completed task_20131031160444934_0010_m_000005 successfully.
2013-10-31 16:09:23,550 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0010 has completed successfully.
2013-10-31 16:09:23,550 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0010,submitTime=1383235732366,launchTime=1383235733408,firstMapTaskLaunchTime=1383235739496,firstReduceTaskLaunchTime=1383235745512,firstJobSetupTaskLaunchTime=1383235733474,firstJobCleanupTaskLaunchTime=1383235757537,finishTime=1383235763550,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2ACF4E5230894D15AF9BC4DFE6B54EB0/B8A324B82B1040EBAE8BAFDA029C9493] cogrouping/(1/2) ...tform/joinsintocogrouplhs
2013-10-31 16:09:23,556 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB. blk_6690545113843447823_1116
2013-10-31 16:09:23,558 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6690545113843447823_1116 src: /127.0.0.1:54524 dest: /127.0.0.1:41648
2013-10-31 16:09:23,561 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6690545113843447823_1116 src: /127.0.0.1:34420 dest: /127.0.0.1:50942
2013-10-31 16:09:23,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6690545113843447823_1116 src: /127.0.0.1:34490 dest: /127.0.0.1:38271
2013-10-31 16:09:23,567 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34490, dest: /127.0.0.1:38271, bytes: 32049, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6690545113843447823_1116, duration: 319389
2013-10-31 16:09:23,568 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6690545113843447823_1116 terminating
2013-10-31 16:09:23,568 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34420, dest: /127.0.0.1:50942, bytes: 32049, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6690545113843447823_1116, duration: 1135902
2013-10-31 16:09:23,569 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6690545113843447823_1116 terminating
2013-10-31 16:09:23,569 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54524, dest: /127.0.0.1:41648, bytes: 32049, op: HDFS_WRITE, cliID: DFSClient_1820866866, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6690545113843447823_1116, duration: 2266858
2013-10-31 16:09:23,570 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6690545113843447823_1116 terminating
2013-10-31 16:09:23,571 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6690545113843447823_1116 size 32049
2013-10-31 16:09:23,573 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6690545113843447823_1116 size 32049
2013-10-31 16:09:23,573 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB from client DFSClient_1820866866
2013-10-31 16:09:23,574 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_logs/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB is closed by DFSClient_1820866866
2013-10-31 16:09:23,574 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6690545113843447823_1116 size 32049
2013-10-31 16:09:23,581 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0010_1383235732366_hadoop_%5B2ACF4E5230894D15AF9BC4DFE6B54EB0%2FB8A324B82B1040EB to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:23,582 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000000_0'
2013-10-31 16:09:23,582 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000001_0'
2013-10-31 16:09:23,583 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000005_0'
2013-10-31 16:09:23,583 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000006_0'
2013-10-31 16:09:23,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1633528743412317819 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,584 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_r_000000_0'
2013-10-31 16:09:23,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1633528743412317819 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1633528743412317819 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,587 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0010_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:23,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0010 dst=null perm=null
2013-10-31 16:09:23,592 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5462009111682244982 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,592 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5462009111682244982 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,592 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5462009111682244982 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,593 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1737899946981776145 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,593 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1737899946981776145 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,593 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1737899946981776145 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,593 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5291005561899941657 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,593 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5291005561899941657 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,594 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5291005561899941657 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,594 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5838032444424121691 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,594 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5838032444424121691 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,594 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5838032444424121691 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,595 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4584120486602198512 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,595 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4584120486602198512 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,595 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4584120486602198512 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,595 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5304158798441442397 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,596 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5304158798441442397 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,596 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5304158798441442397 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:23,596 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4846897092815297308 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:23,596 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4846897092815297308 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:23,596 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4846897092815297308 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:23,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/3084104898_lower_upper_492BC1F630D340CABB58FC3E3179CB43 dst=null perm=null
2013-10-31 16:09:23,604 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary
2013-10-31 16:09:23,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2013-10-31 16:09:23,625 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:23,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2013-10-31 16:09:23,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2013-10-31 16:09:23,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34492, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 426305
2013-10-31 16:09:23,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2013-10-31 16:09:23,652 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:23,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2013-10-31 16:09:23,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2013-10-31 16:09:23,656 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34493, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 406926
2013-10-31 16:09:23,657 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogrouplhs
2013-10-31 16:09:23,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2013-10-31 16:09:23,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2013-10-31 16:09:23,662 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34494, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3690515878603194838_1115, duration: 427386
2013-10-31 16:09:23,673 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:09:23,674 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:09:23,707 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:09:23,707 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:09:23,707 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:09:23,708 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:09:23,708 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:09:23,709 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs"]
2013-10-31 16:09:23,709 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] parallel execution is enabled: true
2013-10-31 16:09:23,709 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting jobs: 2
2013-10-31 16:09:23,709 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] allocating threads: 2
2013-10-31 16:09:23,711 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (2/2)
2013-10-31 16:09:23,715 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:09:23,715 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:09:23,715 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data2/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:23,715 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data1/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:23,715 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data2/current/blk_-7275383232629599215
2013-10-31 16:09:23,715 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data1/current/blk_5876356830892656538
2013-10-31 16:09:23,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:23,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:09:23,918 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275383232629599215_1108 file build/test/data/dfs/data/data7/current/blk_-7275383232629599215 for deletion
2013-10-31 16:09:23,918 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-83841722562286388_1111 file build/test/data/dfs/data/data8/current/blk_-83841722562286388 for deletion
2013-10-31 16:09:23,918 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275383232629599215_1108 at file build/test/data/dfs/data/data7/current/blk_-7275383232629599215
2013-10-31 16:09:23,919 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-83841722562286388_1111 at file build/test/data/dfs/data/data8/current/blk_-83841722562286388
2013-10-31 16:09:23,918 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2593862758334192524_1110 file build/test/data/dfs/data/data7/current/blk_2593862758334192524 for deletion
2013-10-31 16:09:23,919 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5876356830892656538_1109 file build/test/data/dfs/data/data8/current/blk_5876356830892656538 for deletion
2013-10-31 16:09:23,919 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2593862758334192524_1110 at file build/test/data/dfs/data/data7/current/blk_2593862758334192524
2013-10-31 16:09:23,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5876356830892656538_1109 at file build/test/data/dfs/data/data8/current/blk_5876356830892656538
2013-10-31 16:09:24,204 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-5304158798441442397_1106 blk_-4584120486602198512_1106 blk_-5838032444424121691_1103 blk_5462009111682244982_1107 blk_1633528743412317819_1114
2013-10-31 16:09:24,205 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-4846897092815297308_1106 blk_1737899946981776145_1100 blk_-5291005561899941657_1102 blk_-4584120486602198512_1106 blk_-5838032444424121691_1103 blk_5462009111682244982_1107
2013-10-31 16:09:24,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5838032444424121691_1103 file build/test/data/dfs/data/data3/current/blk_-5838032444424121691 for deletion
2013-10-31 16:09:24,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5291005561899941657_1102 file build/test/data/dfs/data/data4/current/blk_-5291005561899941657 for deletion
2013-10-31 16:09:24,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5838032444424121691_1103 at file build/test/data/dfs/data/data3/current/blk_-5838032444424121691
2013-10-31 16:09:24,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4846897092815297308_1106 file build/test/data/dfs/data/data3/current/blk_-4846897092815297308 for deletion
2013-10-31 16:09:24,316 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5291005561899941657_1102 at file build/test/data/dfs/data/data4/current/blk_-5291005561899941657
2013-10-31 16:09:24,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4584120486602198512_1106 file build/test/data/dfs/data/data4/current/blk_-4584120486602198512 for deletion
2013-10-31 16:09:24,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4846897092815297308_1106 at file build/test/data/dfs/data/data3/current/blk_-4846897092815297308
2013-10-31 16:09:24,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1737899946981776145_1100 file build/test/data/dfs/data/data4/current/blk_1737899946981776145 for deletion
2013-10-31 16:09:24,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4584120486602198512_1106 at file build/test/data/dfs/data/data4/current/blk_-4584120486602198512
2013-10-31 16:09:24,318 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5462009111682244982_1107 file build/test/data/dfs/data/data4/current/blk_5462009111682244982 for deletion
2013-10-31 16:09:24,318 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1737899946981776145_1100 at file build/test/data/dfs/data/data4/current/blk_1737899946981776145
2013-10-31 16:09:24,318 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5462009111682244982_1107 at file build/test/data/dfs/data/data4/current/blk_5462009111682244982
2013-10-31 16:09:24,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,719 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar. blk_1251994781094396070_1117
2013-10-31 16:09:24,721 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:47528 dest: /127.0.0.1:47311
2013-10-31 16:09:24,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:34496 dest: /127.0.0.1:38271
2013-10-31 16:09:24,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:54533 dest: /127.0.0.1:41648
2013-10-31 16:09:24,735 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54533, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1251994781094396070_1117, duration: 7331696
2013-10-31 16:09:24,735 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1251994781094396070_1117 terminating
2013-10-31 16:09:24,736 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34496, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 8457384
2013-10-31 16:09:24,736 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:24,736 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1251994781094396070_1117 terminating
2013-10-31 16:09:24,737 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47528, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1251994781094396070_1117, duration: 9279602
2013-10-31 16:09:24,737 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1251994781094396070_1117 terminating
2013-10-31 16:09:24,737 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:24,739 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar from client DFSClient_1457307213
2013-10-31 16:09:24,740 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar is closed by DFSClient_1457307213
2013-10-31 16:09:24,740 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:24,746 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar. New replication is 10
2013-10-31 16:09:24,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar dst=null perm=null
2013-10-31 16:09:24,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,758 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:09:24,763 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:24,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:09:24,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,777 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split. New replication is 10
2013-10-31 16:09:24,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=null
2013-10-31 16:09:24,784 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split. blk_-2068202829203503883_1118
2013-10-31 16:09:24,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:47531 dest: /127.0.0.1:47311
2013-10-31 16:09:24,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:34430 dest: /127.0.0.1:50942
2013-10-31 16:09:24,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:54536 dest: /127.0.0.1:41648
2013-10-31 16:09:24,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2068202829203503883_1118 src: /127.0.0.1:34501 dest: /127.0.0.1:38271
2013-10-31 16:09:24,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34501, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2068202829203503883_1118, duration: 113249
2013-10-31 16:09:24,793 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,794 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54536, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2068202829203503883_1118, duration: 937556
2013-10-31 16:09:24,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34430, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 2096866
2013-10-31 16:09:24,796 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,796 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47531, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2068202829203503883_1118, duration: 3145532
2013-10-31 16:09:24,797 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,797 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2068202829203503883_1118 terminating
2013-10-31 16:09:24,803 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,803 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split from client DFSClient_1457307213
2013-10-31 16:09:24,804 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split is closed by DFSClient_1457307213
2013-10-31 16:09:24,804 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2068202829203503883_1118 size 1732
2013-10-31 16:09:24,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,830 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo. blk_-5329221742438129426_1119
2013-10-31 16:09:24,832 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5329221742438129426_1119 src: /127.0.0.1:47535 dest: /127.0.0.1:47311
2013-10-31 16:09:24,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5329221742438129426_1119 src: /127.0.0.1:54539 dest: /127.0.0.1:41648
2013-10-31 16:09:24,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5329221742438129426_1119 src: /127.0.0.1:34504 dest: /127.0.0.1:38271
2013-10-31 16:09:24,838 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34504, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5329221742438129426_1119, duration: 65758
2013-10-31 16:09:24,838 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5329221742438129426_1119 terminating
2013-10-31 16:09:24,839 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54539, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5329221742438129426_1119, duration: 834017
2013-10-31 16:09:24,839 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5329221742438129426_1119 terminating
2013-10-31 16:09:24,839 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47535, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5329221742438129426_1119, duration: 1696844
2013-10-31 16:09:24,840 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5329221742438129426_1119 terminating
2013-10-31 16:09:24,843 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5329221742438129426_1119 size 183
2013-10-31 16:09:24,843 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:09:24,843 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:09:24,844 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5329221742438129426_1119 size 183
2013-10-31 16:09:24,844 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5329221742438129426_1119 size 183
2013-10-31 16:09:24,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,871 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml. blk_-2920999921881403397_1120
2013-10-31 16:09:24,873 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2920999921881403397_1120 src: /127.0.0.1:34436 dest: /127.0.0.1:50942
2013-10-31 16:09:24,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2920999921881403397_1120 src: /127.0.0.1:54542 dest: /127.0.0.1:41648
2013-10-31 16:09:24,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2920999921881403397_1120 src: /127.0.0.1:34507 dest: /127.0.0.1:38271
2013-10-31 16:09:24,880 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34507, dest: /127.0.0.1:38271, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2920999921881403397_1120, duration: 159608
2013-10-31 16:09:24,880 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2920999921881403397_1120 terminating
2013-10-31 16:09:24,881 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54542, dest: /127.0.0.1:41648, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2920999921881403397_1120, duration: 990403
2013-10-31 16:09:24,881 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2920999921881403397_1120 terminating
2013-10-31 16:09:24,882 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34436, dest: /127.0.0.1:50942, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2920999921881403397_1120, duration: 1872973
2013-10-31 16:09:24,882 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2920999921881403397_1120 terminating
2013-10-31 16:09:24,885 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2920999921881403397_1120 size 28557
2013-10-31 16:09:24,885 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml from client DFSClient_1457307213
2013-10-31 16:09:24,886 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml is closed by DFSClient_1457307213
2013-10-31 16:09:24,886 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2920999921881403397_1120 size 28557
2013-10-31 16:09:24,887 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2920999921881403397_1120 size 28557
2013-10-31 16:09:24,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml dst=null perm=null
2013-10-31 16:09:24,902 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54545, bytes: 28781, op: HDFS_READ, cliID: DFSClient_400949537, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2920999921881403397_1120, duration: 393111
2013-10-31 16:09:24,921 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0011: nMaps=5 nReduces=0 max=-1
2013-10-31 16:09:24,921 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0011 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:09:24,921 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0011
2013-10-31 16:09:24,921 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0011 RESULT=SUCCESS
2013-10-31 16:09:24,922 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0011
2013-10-31 16:09:24,924 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0011
2013-10-31 16:09:24,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5838032444424121691_1103 file build/test/data/dfs/data/data6/current/blk_-5838032444424121691 for deletion
2013-10-31 16:09:24,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5304158798441442397_1106 file build/test/data/dfs/data/data5/current/blk_-5304158798441442397 for deletion
2013-10-31 16:09:24,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5838032444424121691_1103 at file build/test/data/dfs/data/data6/current/blk_-5838032444424121691
2013-10-31 16:09:24,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4584120486602198512_1106 file build/test/data/dfs/data/data6/current/blk_-4584120486602198512 for deletion
2013-10-31 16:09:24,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5304158798441442397_1106 at file build/test/data/dfs/data/data5/current/blk_-5304158798441442397
2013-10-31 16:09:24,930 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4584120486602198512_1106 at file build/test/data/dfs/data/data6/current/blk_-4584120486602198512
2013-10-31 16:09:24,930 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1633528743412317819_1114 file build/test/data/dfs/data/data6/current/blk_1633528743412317819 for deletion
2013-10-31 16:09:24,931 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5462009111682244982_1107 file build/test/data/dfs/data/data5/current/blk_5462009111682244982 for deletion
2013-10-31 16:09:24,931 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1633528743412317819_1114 at file build/test/data/dfs/data/data6/current/blk_1633528743412317819
2013-10-31 16:09:24,931 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5462009111682244982_1107 at file build/test/data/dfs/data/data5/current/blk_5462009111682244982
2013-10-31 16:09:24,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:24,963 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml. blk_-4432548704645493821_1122
2013-10-31 16:09:24,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4432548704645493821_1122 src: /127.0.0.1:34510 dest: /127.0.0.1:38271
2013-10-31 16:09:24,966 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4432548704645493821_1122 src: /127.0.0.1:54547 dest: /127.0.0.1:41648
2013-10-31 16:09:24,968 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4432548704645493821_1122 src: /127.0.0.1:34443 dest: /127.0.0.1:50942
2013-10-31 16:09:24,972 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34443, dest: /127.0.0.1:50942, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4432548704645493821_1122, duration: 481518
2013-10-31 16:09:24,973 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4432548704645493821_1122 terminating
2013-10-31 16:09:24,973 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54547, dest: /127.0.0.1:41648, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4432548704645493821_1122, duration: 2092644
2013-10-31 16:09:24,974 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4432548704645493821_1122 terminating
2013-10-31 16:09:24,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4432548704645493821_1122 size 28622
2013-10-31 16:09:24,974 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34510, dest: /127.0.0.1:38271, bytes: 28622, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4432548704645493821_1122, duration: 2142257
2013-10-31 16:09:24,975 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4432548704645493821_1122 terminating
2013-10-31 16:09:24,977 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4432548704645493821_1122 size 28622
2013-10-31 16:09:24,977 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml from client DFSClient_400949537
2013-10-31 16:09:24,978 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_conf.xml is closed by DFSClient_400949537
2013-10-31 16:09:24,978 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4432548704645493821_1122 size 28622
2013-10-31 16:09:25,553 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000004_0'
2013-10-31 16:09:25,555 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:25,555 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0010 being deleted.
2013-10-31 16:09:26,549 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000002_0'
2013-10-31 16:09:26,550 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0010_m_000003_0'
2013-10-31 16:09:27,205 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_1251994781094396070_1117 to datanode(s) 127.0.0.1:50942
2013-10-31 16:09:27,206 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-4846897092815297308_1106 blk_1737899946981776145_1100 blk_-5291005561899941657_1102 blk_-5304158798441442397_1106 blk_-4584120486602198512_1106 blk_-5838032444424121691_1103 blk_5462009111682244982_1107 blk_1633528743412317819_1114
2013-10-31 16:09:27,206 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-4846897092815297308_1106 blk_1737899946981776145_1100 blk_-5291005561899941657_1102 blk_-5304158798441442397_1106 blk_1633528743412317819_1114
2013-10-31 16:09:27,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:27,437 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken. blk_8021674872422085597_1123
2013-10-31 16:09:27,439 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8021674872422085597_1123 src: /127.0.0.1:34444 dest: /127.0.0.1:50942
2013-10-31 16:09:27,441 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8021674872422085597_1123 src: /127.0.0.1:47547 dest: /127.0.0.1:47311
2013-10-31 16:09:27,443 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8021674872422085597_1123 src: /127.0.0.1:34515 dest: /127.0.0.1:38271
2013-10-31 16:09:27,445 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34515, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8021674872422085597_1123, duration: 69030
2013-10-31 16:09:27,446 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8021674872422085597_1123 terminating
2013-10-31 16:09:27,446 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8021674872422085597_1123 size 116
2013-10-31 16:09:27,446 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47547, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8021674872422085597_1123, duration: 841103
2013-10-31 16:09:27,447 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8021674872422085597_1123 terminating
2013-10-31 16:09:27,447 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34444, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8021674872422085597_1123, duration: 1749976
2013-10-31 16:09:27,448 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8021674872422085597_1123 terminating
2013-10-31 16:09:27,450 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8021674872422085597_1123 size 116
2013-10-31 16:09:27,450 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken from client DFSClient_1457307213
2013-10-31 16:09:27,451 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken is closed by DFSClient_1457307213
2013-10-31 16:09:27,451 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8021674872422085597_1123 size 116
2013-10-31 16:09:27,457 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken
2013-10-31 16:09:27,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.splitmetainfo dst=null perm=null
2013-10-31 16:09:27,461 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47549, bytes: 187, op: HDFS_READ, cliID: DFSClient_400949537, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5329221742438129426_1119, duration: 275667
2013-10-31 16:09:27,463 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0011 = 19. Number of splits = 5
2013-10-31 16:09:27,463 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,463 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,464 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,465 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,466 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0011_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:27,467 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0011 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:09:27,467 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0011 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:09:27,929 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_1251994781094396070_1117 to 127.0.0.1:50942
2013-10-31 16:09:27,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1251994781094396070_1117 src: /127.0.0.1:34448 dest: /127.0.0.1:50942
2013-10-31 16:09:27,932 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_1251994781094396070_1117 to /127.0.0.1:50942
2013-10-31 16:09:27,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1251994781094396070_1117 src: /127.0.0.1:34448 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:09:27,939 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1251994781094396070_1117 size 238055
2013-10-31 16:09:28,558 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0011_m_000006_0' to tip task_20131031160444934_0011_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:28,565 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:09:28,565 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000006_0 which needs 1 slots
2013-10-31 16:09:28,565 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000006_0 which needs 1 slots
2013-10-31 16:09:28,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken dst=null perm=null
2013-10-31 16:09:28,574 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34518, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8021674872422085597_1123, duration: 271270
2013-10-31 16:09:28,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml dst=null perm=null
2013-10-31 16:09:28,585 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34520, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-77837723, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2920999921881403397_1120, duration: 381378
2013-10-31 16:09:28,585 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:28,585 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0010_m_000005_0 not found in cache
2013-10-31 16:09:28,587 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0010 for user-log deletion with retainTimeStamp:1383322168587
2013-10-31 16:09:28,633 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:28,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar dst=null perm=null
2013-10-31 16:09:28,656 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34521, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-77837723, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 1450081
2013-10-31 16:09:28,754 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1944950700
2013-10-31 16:09:28,754 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1944950700 spawned.
2013-10-31 16:09:28,756 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000006_0/taskjvm.sh
2013-10-31 16:09:28,786 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_103663412 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:28,795 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15407 with signal TERM. Exit code 0
2013-10-31 16:09:28,824 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_r_266027598 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:28,833 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15865 with signal TERM. Exit code 0
2013-10-31 16:09:28,977 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:28,978 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:28,978 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:28,979 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_103663412 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:28,995 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:28,995 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:28,995 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:28,995 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_r_266027598 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:29,082 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_970588561 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:29,092 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15559 with signal TERM. Exit code 0
2013-10-31 16:09:29,300 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:29,300 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:29,300 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:29,300 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_970588561 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:29,717 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5304158798441442397_1106 file build/test/data/dfs/data/data2/current/blk_-5304158798441442397 for deletion
2013-10-31 16:09:29,717 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5291005561899941657_1102 file build/test/data/dfs/data/data1/current/blk_-5291005561899941657 for deletion
2013-10-31 16:09:29,717 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5304158798441442397_1106 at file build/test/data/dfs/data/data2/current/blk_-5304158798441442397
2013-10-31 16:09:29,717 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4846897092815297308_1106 file build/test/data/dfs/data/data1/current/blk_-4846897092815297308 for deletion
2013-10-31 16:09:29,718 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5291005561899941657_1102 at file build/test/data/dfs/data/data1/current/blk_-5291005561899941657
2013-10-31 16:09:29,718 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1633528743412317819_1114 file build/test/data/dfs/data/data1/current/blk_1633528743412317819 for deletion
2013-10-31 16:09:29,718 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4846897092815297308_1106 at file build/test/data/dfs/data/data1/current/blk_-4846897092815297308
2013-10-31 16:09:29,718 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1737899946981776145_1100 file build/test/data/dfs/data/data2/current/blk_1737899946981776145 for deletion
2013-10-31 16:09:29,718 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1633528743412317819_1114 at file build/test/data/dfs/data/data1/current/blk_1633528743412317819
2013-10-31 16:09:29,718 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1737899946981776145_1100 at file build/test/data/dfs/data/data2/current/blk_1737899946981776145
2013-10-31 16:09:29,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5838032444424121691_1103 file build/test/data/dfs/data/data8/current/blk_-5838032444424121691 for deletion
2013-10-31 16:09:29,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5304158798441442397_1106 file build/test/data/dfs/data/data7/current/blk_-5304158798441442397 for deletion
2013-10-31 16:09:29,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5838032444424121691_1103 at file build/test/data/dfs/data/data8/current/blk_-5838032444424121691
2013-10-31 16:09:29,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5291005561899941657_1102 file build/test/data/dfs/data/data7/current/blk_-5291005561899941657 for deletion
2013-10-31 16:09:29,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5304158798441442397_1106 at file build/test/data/dfs/data/data7/current/blk_-5304158798441442397
2013-10-31 16:09:29,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4846897092815297308_1106 file build/test/data/dfs/data/data7/current/blk_-4846897092815297308 for deletion
2013-10-31 16:09:29,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5291005561899941657_1102 at file build/test/data/dfs/data/data7/current/blk_-5291005561899941657
2013-10-31 16:09:29,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4584120486602198512_1106 file build/test/data/dfs/data/data8/current/blk_-4584120486602198512 for deletion
2013-10-31 16:09:29,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4846897092815297308_1106 at file build/test/data/dfs/data/data7/current/blk_-4846897092815297308
2013-10-31 16:09:29,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4584120486602198512_1106 at file build/test/data/dfs/data/data8/current/blk_-4584120486602198512
2013-10-31 16:09:29,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1633528743412317819_1114 file build/test/data/dfs/data/data7/current/blk_1633528743412317819 for deletion
2013-10-31 16:09:29,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1633528743412317819_1114 at file build/test/data/dfs/data/data7/current/blk_1633528743412317819
2013-10-31 16:09:29,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1737899946981776145_1100 file build/test/data/dfs/data/data8/current/blk_1737899946981776145 for deletion
2013-10-31 16:09:29,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1737899946981776145_1100 at file build/test/data/dfs/data/data8/current/blk_1737899946981776145
2013-10-31 16:09:29,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5462009111682244982_1107 file build/test/data/dfs/data/data8/current/blk_5462009111682244982 for deletion
2013-10-31 16:09:29,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5462009111682244982_1107 at file build/test/data/dfs/data/data8/current/blk_5462009111682244982
2013-10-31 16:09:30,112 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1944950700 given task: attempt_20131031160444934_0011_m_000006_0
2013-10-31 16:09:30,554 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:30,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0010 for user-log deletion with retainTimeStamp:1383322170555
2013-10-31 16:09:30,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:31,131 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_-616353992 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:31,141 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15777 with signal TERM. Exit code 0
2013-10-31 16:09:31,354 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:31,354 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:31,354 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:31,354 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_-616353992 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:31,550 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0010
2013-10-31 16:09:31,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0010 for user-log deletion with retainTimeStamp:1383322171551
2013-10-31 16:09:31,895 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_2036878026 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:31,906 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15614 with signal TERM. Exit code 0
2013-10-31 16:09:31,976 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0010_m_-1794027183 since job job_20131031160444934_0010 is dead
2013-10-31 16:09:31,981 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15649 with signal TERM. Exit code 0
2013-10-31 16:09:32,111 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:32,111 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:32,111 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:32,112 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_2036878026 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:32,163 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:32,163 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:32,163 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:32,163 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0010_m_-1794027183 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:33,548 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000006_0 0.0% setup
2013-10-31 16:09:33,551 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000006_0 is done.
2013-10-31 16:09:33,551 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000006_0 was -1
2013-10-31 16:09:33,552 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:34,571 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000006_0' has completed task_20131031160444934_0011_m_000006 successfully.
2013-10-31 16:09:34,703 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000000_0' to tip task_20131031160444934_0011_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:34,705 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000000
2013-10-31 16:09:34,705 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000001_0' to tip task_20131031160444934_0011_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:34,706 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000001
2013-10-31 16:09:34,708 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:09:34,709 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:09:34,709 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000000_0 which needs 1 slots
2013-10-31 16:09:34,709 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000000_0 which needs 1 slots
2013-10-31 16:09:34,710 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000001_0 which needs 1 slots
2013-10-31 16:09:34,710 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0011_m_000001_0 which needs 1 slots
2013-10-31 16:09:34,950 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1477786192
2013-10-31 16:09:34,951 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1477786192 spawned.
2013-10-31 16:09:34,953 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0011/attempt_20131031160444934_0011_m_000001_0. Attempting to reuse: jvm_20131031160444934_0011_m_-1944950700
2013-10-31 16:09:34,955 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000000_0/taskjvm.sh
2013-10-31 16:09:35,107 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1944950700 given task: attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:35,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=null
2013-10-31 16:09:35,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47562, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2068202829203503883_1118, duration: 166494
2013-10-31 16:09:35,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:09:35,252 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34461, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 125861
2013-10-31 16:09:35,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:35,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:35,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:35,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:35,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34462, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 147296
2013-10-31 16:09:35,535 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001. blk_-2376389404784738128_1124
2013-10-31 16:09:35,551 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2376389404784738128_1124 src: /127.0.0.1:47565 dest: /127.0.0.1:47311
2013-10-31 16:09:35,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2376389404784738128_1124 src: /127.0.0.1:34533 dest: /127.0.0.1:38271
2013-10-31 16:09:35,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2376389404784738128_1124 src: /127.0.0.1:34465 dest: /127.0.0.1:50942
2013-10-31 16:09:35,555 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34465, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2376389404784738128_1124, duration: 1123861
2013-10-31 16:09:35,555 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2376389404784738128_1124 terminating
2013-10-31 16:09:35,555 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2376389404784738128_1124 size 104
2013-10-31 16:09:35,555 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34533, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2376389404784738128_1124, duration: 1561459
2013-10-31 16:09:35,555 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2376389404784738128_1124 terminating
2013-10-31 16:09:35,555 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47565, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2376389404784738128_1124, duration: 1947201
2013-10-31 16:09:35,556 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2376389404784738128_1124 terminating
2013-10-31 16:09:35,557 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2376389404784738128_1124 size 104
2013-10-31 16:09:35,557 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:35,557 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:35,557 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2376389404784738128_1124 size 104
2013-10-31 16:09:35,559 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000002_0' to tip task_20131031160444934_0011_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:09:35,559 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000002
2013-10-31 16:09:35,559 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000003_0' to tip task_20131031160444934_0011_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:09:35,560 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000003
2013-10-31 16:09:35,560 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:09:35,561 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:09:35,561 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000002_0 which needs 1 slots
2013-10-31 16:09:35,561 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000002_0 which needs 1 slots
2013-10-31 16:09:35,561 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000003_0 which needs 1 slots
2013-10-31 16:09:35,561 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0011_m_000003_0 which needs 1 slots
2013-10-31 16:09:35,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken dst=null perm=null
2013-10-31 16:09:35,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34535, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8021674872422085597_1123, duration: 129745
2013-10-31 16:09:35,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml dst=null perm=null
2013-10-31 16:09:35,569 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34537, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-19108433, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2920999921881403397_1120, duration: 160183
2013-10-31 16:09:35,582 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:35,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar dst=null perm=null
2013-10-31 16:09:35,594 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:35,594 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000001_0 0.0%
2013-10-31 16:09:35,596 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34538, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-19108433, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 663355
2013-10-31 16:09:35,596 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0011_m_000004_0' to tip task_20131031160444934_0011_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:09:35,596 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0011_m_000004
2013-10-31 16:09:35,597 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:09:35,597 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000004_0 which needs 1 slots
2013-10-31 16:09:35,597 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000004_0 which needs 1 slots
2013-10-31 16:09:35,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011/jobToken dst=null perm=null
2013-10-31 16:09:35,601 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34470, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8021674872422085597_1123, duration: 152214
2013-10-31 16:09:35,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.xml dst=null perm=null
2013-10-31 16:09:35,605 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34473, bytes: 28781, op: HDFS_READ, cliID: DFSClient_-872694833, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2920999921881403397_1120, duration: 157613
2013-10-31 16:09:35,617 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:35,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.jar dst=null perm=null
2013-10-31 16:09:35,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34543, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-872694833, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1251994781094396070_1117, duration: 733547
2013-10-31 16:09:35,650 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1008552155
2013-10-31 16:09:35,651 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1008552155 spawned.
2013-10-31 16:09:35,651 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_-1264582295
2013-10-31 16:09:35,652 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_-1264582295 spawned.
2013-10-31 16:09:35,652 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000003_0/taskjvm.sh
2013-10-31 16:09:35,653 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000002_0/taskjvm.sh
2013-10-31 16:09:35,773 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1477786192 given task: attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:35,943 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0011_m_448877274
2013-10-31 16:09:35,944 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0011_m_448877274 spawned.
2013-10-31 16:09:35,945 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0011/attempt_20131031160444934_0011_m_000004_0/taskjvm.sh
2013-10-31 16:09:36,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=null
2013-10-31 16:09:36,278 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34545, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2068202829203503883_1118, duration: 168828
2013-10-31 16:09:36,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:09:36,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:36,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:36,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:36,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:36,606 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34477, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 140119
2013-10-31 16:09:36,609 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34478, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 135493
2013-10-31 16:09:36,617 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000. blk_4463643465988243742_1125
2013-10-31 16:09:36,640 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4463643465988243742_1125 src: /127.0.0.1:34548 dest: /127.0.0.1:38271
2013-10-31 16:09:36,641 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4463643465988243742_1125 src: /127.0.0.1:54585 dest: /127.0.0.1:41648
2013-10-31 16:09:36,641 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4463643465988243742_1125 src: /127.0.0.1:47583 dest: /127.0.0.1:47311
2013-10-31 16:09:36,644 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47583, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4463643465988243742_1125, duration: 1234664
2013-10-31 16:09:36,644 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4463643465988243742_1125 terminating
2013-10-31 16:09:36,644 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54585, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4463643465988243742_1125, duration: 1587430
2013-10-31 16:09:36,644 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4463643465988243742_1125 size 104
2013-10-31 16:09:36,644 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4463643465988243742_1125 terminating
2013-10-31 16:09:36,644 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34548, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4463643465988243742_1125, duration: 2025687
2013-10-31 16:09:36,644 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4463643465988243742_1125 size 104
2013-10-31 16:09:36,645 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4463643465988243742_1125 terminating
2013-10-31 16:09:36,646 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:36,646 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:36,647 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4463643465988243742_1125 size 104
2013-10-31 16:09:36,695 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:36,695 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000000_0 0.0%
2013-10-31 16:09:37,026 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1008552155 given task: attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:37,103 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_448877274 given task: attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:37,106 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1264582295 given task: attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:37,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=null
2013-10-31 16:09:37,525 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34488, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 170299
2013-10-31 16:09:37,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:09:37,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34558, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 126748
2013-10-31 16:09:37,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:37,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=null
2013-10-31 16:09:37,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011/job.split dst=null perm=null
2013-10-31 16:09:37,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:37,597 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34490, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 234669
2013-10-31 16:09:37,599 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34491, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2068202829203503883_1118, duration: 151967
2013-10-31 16:09:37,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:09:37,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:09:37,636 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34561, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 124856
2013-10-31 16:09:37,638 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47595, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 116494
2013-10-31 16:09:37,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:37,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:37,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:37,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:37,710 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000000_0
2013-10-31 16:09:37,710 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000001_0
2013-10-31 16:09:37,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:37,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:37,819 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54599, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 163496
2013-10-31 16:09:37,829 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003. blk_-7874678964818902618_1128
2013-10-31 16:09:37,851 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7874678964818902618_1128 src: /127.0.0.1:34564 dest: /127.0.0.1:38271
2013-10-31 16:09:37,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7874678964818902618_1128 src: /127.0.0.1:47598 dest: /127.0.0.1:47311
2013-10-31 16:09:37,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7874678964818902618_1128 src: /127.0.0.1:34497 dest: /127.0.0.1:50942
2013-10-31 16:09:37,855 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34497, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7874678964818902618_1128, duration: 1141287
2013-10-31 16:09:37,855 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7874678964818902618_1128 terminating
2013-10-31 16:09:37,855 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47598, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7874678964818902618_1128, duration: 1608669
2013-10-31 16:09:37,855 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7874678964818902618_1128 terminating
2013-10-31 16:09:37,856 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34564, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7874678964818902618_1128, duration: 2007387
2013-10-31 16:09:37,856 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7874678964818902618_1128 terminating
2013-10-31 16:09:37,858 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7874678964818902618_1128 size 104
2013-10-31 16:09:37,858 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7874678964818902618_1128 size 104
2013-10-31 16:09:37,860 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7874678964818902618_1128 size 104
2013-10-31 16:09:37,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:37,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:37,886 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54603, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 120995
2013-10-31 16:09:37,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:37,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:09:37,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54604, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 109715
2013-10-31 16:09:37,896 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004. blk_-3681265296073978596_1128
2013-10-31 16:09:37,903 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002. blk_6334597591235643953_1128
2013-10-31 16:09:37,919 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3681265296073978596_1128 src: /127.0.0.1:34569 dest: /127.0.0.1:38271
2013-10-31 16:09:37,920 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3681265296073978596_1128 src: /127.0.0.1:34502 dest: /127.0.0.1:50942
2013-10-31 16:09:37,921 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3681265296073978596_1128 src: /127.0.0.1:47605 dest: /127.0.0.1:47311
2013-10-31 16:09:37,923 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47605, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3681265296073978596_1128, duration: 1047807
2013-10-31 16:09:37,923 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3681265296073978596_1128 terminating
2013-10-31 16:09:37,923 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3681265296073978596_1128 size 104
2013-10-31 16:09:37,923 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34502, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3681265296073978596_1128, duration: 1400650
2013-10-31 16:09:37,923 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3681265296073978596_1128 terminating
2013-10-31 16:09:37,923 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34569, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3681265296073978596_1128, duration: 1751457
2013-10-31 16:09:37,924 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3681265296073978596_1128 terminating
2013-10-31 16:09:37,924 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:37,925 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:37,925 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3681265296073978596_1128 size 104
2013-10-31 16:09:37,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6334597591235643953_1128 src: /127.0.0.1:54606 dest: /127.0.0.1:41648
2013-10-31 16:09:37,925 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3681265296073978596_1128 size 104
2013-10-31 16:09:37,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6334597591235643953_1128 src: /127.0.0.1:34573 dest: /127.0.0.1:38271
2013-10-31 16:09:37,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6334597591235643953_1128 src: /127.0.0.1:34505 dest: /127.0.0.1:50942
2013-10-31 16:09:37,928 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34505, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6334597591235643953_1128, duration: 1094857
2013-10-31 16:09:37,928 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6334597591235643953_1128 terminating
2013-10-31 16:09:37,929 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34573, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6334597591235643953_1128, duration: 1344616
2013-10-31 16:09:37,929 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6334597591235643953_1128 size 104
2013-10-31 16:09:37,929 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6334597591235643953_1128 terminating
2013-10-31 16:09:37,929 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54606, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0011_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6334597591235643953_1128, duration: 1752182
2013-10-31 16:09:37,929 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6334597591235643953_1128 terminating
2013-10-31 16:09:37,930 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6334597591235643953_1128 size 104
2013-10-31 16:09:37,930 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:37,930 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:37,931 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6334597591235643953_1128 size 104
2013-10-31 16:09:37,975 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:37,975 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000004_0 0.0%
2013-10-31 16:09:37,984 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:37,984 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000002_0 0.0%
2013-10-31 16:09:38,258 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:38,258 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:38,323 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0011_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:09:38,324 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000003_0 0.0%
2013-10-31 16:09:38,565 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000002_0
2013-10-31 16:09:38,566 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000003_0
2013-10-31 16:09:38,600 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0011_m_000004_0
2013-10-31 16:09:38,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0 dst=null perm=null
2013-10-31 16:09:38,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:38,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0 dst=null perm=null
2013-10-31 16:09:38,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:38,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0 dst=null perm=null
2013-10-31 16:09:38,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:38,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0 dst=null perm=null
2013-10-31 16:09:38,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:39,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0/part-00004 dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000001_0 dst=null perm=null
2013-10-31 16:09:39,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000000_0 dst=null perm=null
2013-10-31 16:09:39,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000004_0 dst=null perm=null
2013-10-31 16:09:39,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000002_0 dst=null perm=null
2013-10-31 16:09:39,207 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:09:39,209 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000000_0 is done.
2013-10-31 16:09:39,209 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000000_0 was -1
2013-10-31 16:09:39,209 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:39,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0 dst=null perm=null
2013-10-31 16:09:39,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:39,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:39,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary/_attempt_20131031160444934_0011_m_000003_0 dst=null perm=null
2013-10-31 16:09:39,709 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0011_m_000006_0
2013-10-31 16:09:39,710 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0011_m_000006_0
2013-10-31 16:09:39,710 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000006_0 not found in cache
2013-10-31 16:09:39,848 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:09:39,857 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,878 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,884 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:09:39,884 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:09:40,452 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:09:40,454 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000003_0 is done.
2013-10-31 16:09:40,455 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000003_0 was -1
2013-10-31 16:09:40,455 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:09:40,521 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:09:40,522 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000004_0 is done.
2013-10-31 16:09:40,522 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000004_0 was -1
2013-10-31 16:09:40,522 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:40,524 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:09:40,525 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000002_0 is done.
2013-10-31 16:09:40,525 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000002_0 was -1
2013-10-31 16:09:40,525 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:40,712 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000000_0' has completed task_20131031160444934_0011_m_000000 successfully.
2013-10-31 16:09:41,232 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:09:41,237 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:09:41,239 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000001_0 is done.
2013-10-31 16:09:41,239 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000001_0 was -1
2013-10-31 16:09:41,239 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:41,569 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000002_0' has completed task_20131031160444934_0011_m_000002 successfully.
2013-10-31 16:09:41,571 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000003_0' has completed task_20131031160444934_0011_m_000003 successfully.
2013-10-31 16:09:41,603 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000004_0' has completed task_20131031160444934_0011_m_000004 successfully.
2013-10-31 16:09:43,716 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000001_0' has completed task_20131031160444934_0011_m_000001 successfully.
2013-10-31 16:09:43,721 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0011_m_000005_0' to tip task_20131031160444934_0011_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:43,723 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0011_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:09:43,724 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0011_m_000005_0 which needs 1 slots
2013-10-31 16:09:43,724 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0011_m_000005_0 which needs 1 slots
2013-10-31 16:09:43,760 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0011/attempt_20131031160444934_0011_m_000005_0. Attempting to reuse: jvm_20131031160444934_0011_m_-1477786192
2013-10-31 16:09:44,267 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0011_m_-1477786192 given task: attempt_20131031160444934_0011_m_000005_0
2013-10-31 16:09:44,475 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000005_0 0.0%
2013-10-31 16:09:44,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_temporary dst=null perm=null
2013-10-31 16:09:44,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:44,498 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_SUCCESS from client DFSClient_attempt_20131031160444934_0011_m_000005_0
2013-10-31 16:09:44,498 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0011_m_000005_0
2013-10-31 16:09:44,509 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,509 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:44,509 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,509 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1251994781094396070 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:44,510 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,510 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,510 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:44,510 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2068202829203503883 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:44,511 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5329221742438129426 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,511 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5329221742438129426 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:44,511 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5329221742438129426 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,511 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2920999921881403397 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:44,511 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2920999921881403397 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:09:44,512 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2920999921881403397 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:44,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0011 dst=null perm=null
2013-10-31 16:09:45,210 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-5329221742438129426_1119 blk_-2068202829203503883_1118 blk_1251994781094396070_1117 blk_-2920999921881403397_1120
2013-10-31 16:09:45,210 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-5329221742438129426_1119 blk_-2068202829203503883_1118 blk_1251994781094396070_1117
2013-10-31 16:09:45,323 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5329221742438129426_1119 file build/test/data/dfs/data/data3/current/blk_-5329221742438129426 for deletion
2013-10-31 16:09:45,323 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data4/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:45,323 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5329221742438129426_1119 at file build/test/data/dfs/data/data3/current/blk_-5329221742438129426
2013-10-31 16:09:45,323 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data3/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:45,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data4/current/blk_-2068202829203503883
2013-10-31 16:09:45,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data3/current/blk_1251994781094396070
2013-10-31 16:09:45,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5329221742438129426_1119 file build/test/data/dfs/data/data6/current/blk_-5329221742438129426 for deletion
2013-10-31 16:09:45,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2920999921881403397_1120 file build/test/data/dfs/data/data5/current/blk_-2920999921881403397 for deletion
2013-10-31 16:09:45,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5329221742438129426_1119 at file build/test/data/dfs/data/data6/current/blk_-5329221742438129426
2013-10-31 16:09:45,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data5/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:45,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2920999921881403397_1120 at file build/test/data/dfs/data/data5/current/blk_-2920999921881403397
2013-10-31 16:09:45,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data6/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:45,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data5/current/blk_-2068202829203503883
2013-10-31 16:09:45,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data6/current/blk_1251994781094396070
2013-10-31 16:09:47,437 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0011_m_000005_0 0.0% cleanup
2013-10-31 16:09:47,439 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0011_m_000005_0 is done.
2013-10-31 16:09:47,439 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0011_m_000005_0 was -1
2013-10-31 16:09:47,439 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:48,211 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-2068202829203503883_1118 blk_1251994781094396070_1117 blk_-2920999921881403397_1120
2013-10-31 16:09:48,211 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5329221742438129426_1119 blk_-2068202829203503883_1118 blk_1251994781094396070_1117 blk_-2920999921881403397_1120
2013-10-31 16:09:49,730 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0011_m_000005_0' has completed task_20131031160444934_0011_m_000005 successfully.
2013-10-31 16:09:49,731 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0011 has completed successfully.
2013-10-31 16:09:49,731 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0011,submitTime=1383235764892,launchTime=1383235767467,firstMapTaskLaunchTime=1383235774703,firstJobSetupTaskLaunchTime=1383235768558,firstJobCleanupTaskLaunchTime=1383235783721,finishTime=1383235789731,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C96242DE50E048DEA55073ACCDC74EF6/B5A2F1F6415F49408144B67DCA7F4220] cogrouping/(2/2)
2013-10-31 16:09:49,820 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940. blk_4928171777644314206_1129
2013-10-31 16:09:49,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4928171777644314206_1129 src: /127.0.0.1:54613 dest: /127.0.0.1:41648
2013-10-31 16:09:49,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4928171777644314206_1129 src: /127.0.0.1:34509 dest: /127.0.0.1:50942
2013-10-31 16:09:49,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4928171777644314206_1129 src: /127.0.0.1:47612 dest: /127.0.0.1:47311
2013-10-31 16:09:49,835 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47612, dest: /127.0.0.1:47311, bytes: 26344, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4928171777644314206_1129, duration: 4915184
2013-10-31 16:09:49,836 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4928171777644314206_1129 terminating
2013-10-31 16:09:49,836 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34509, dest: /127.0.0.1:50942, bytes: 26344, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4928171777644314206_1129, duration: 4904892
2013-10-31 16:09:49,837 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4928171777644314206_1129 terminating
2013-10-31 16:09:49,837 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54613, dest: /127.0.0.1:41648, bytes: 26344, op: HDFS_WRITE, cliID: DFSClient_400949537, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4928171777644314206_1129, duration: 5772035
2013-10-31 16:09:49,838 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4928171777644314206_1129 terminating
2013-10-31 16:09:49,842 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4928171777644314206_1129 size 26344
2013-10-31 16:09:49,843 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940 from client DFSClient_400949537
2013-10-31 16:09:49,843 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/_logs/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940 is closed by DFSClient_400949537
2013-10-31 16:09:49,844 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 693 Total time for transactions(ms): 11Number of transactions batched in Syncs: 64 Number of syncs: 492 SyncTimes(ms): 20461 2621
2013-10-31 16:09:49,844 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4928171777644314206_1129 size 26344
2013-10-31 16:09:49,844 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4928171777644314206_1129 size 26344
2013-10-31 16:09:49,853 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0011_1383235764892_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2FB5A2F1F6415F4940 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:49,856 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000000_0'
2013-10-31 16:09:49,856 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000001_0'
2013-10-31 16:09:49,856 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000005_0'
2013-10-31 16:09:49,856 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000006_0'
2013-10-31 16:09:49,862 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0011_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:09:49,863 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouprhs
2013-10-31 16:09:49,872 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:09:49,873 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8021674872422085597 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:09:49,873 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8021674872422085597 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:09:49,873 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8021674872422085597 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:09:49,875 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:09:49,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0011 dst=null perm=null
2013-10-31 16:09:49,880 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:09:49,880 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:09:49,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:49,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:09:49,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:49,948 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar. blk_145049323396269548_1130
2013-10-31 16:09:49,949 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:34512 dest: /127.0.0.1:50942
2013-10-31 16:09:49,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:34582 dest: /127.0.0.1:38271
2013-10-31 16:09:49,953 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:47616 dest: /127.0.0.1:47311
2013-10-31 16:09:49,966 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47616, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_145049323396269548_1130, duration: 9453948
2013-10-31 16:09:49,966 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_145049323396269548_1130 terminating
2013-10-31 16:09:49,966 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34582, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_145049323396269548_1130, duration: 11050344
2013-10-31 16:09:49,967 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:49,967 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_145049323396269548_1130 terminating
2013-10-31 16:09:49,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34512, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_145049323396269548_1130, duration: 11200886
2013-10-31 16:09:49,968 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:49,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_145049323396269548_1130 terminating
2013-10-31 16:09:49,970 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar from client DFSClient_1457307213
2013-10-31 16:09:49,970 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar is closed by DFSClient_1457307213
2013-10-31 16:09:49,971 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:49,979 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar. New replication is 10
2013-10-31 16:09:49,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar dst=null perm=null
2013-10-31 16:09:49,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:49,994 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:09:49,999 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:09:50,003 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:09:50,006 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:09:50,009 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:09:50,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:09:50,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,421 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split. New replication is 10
2013-10-31 16:09:50,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=null
2013-10-31 16:09:50,429 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split. blk_-179423042782344656_1131
2013-10-31 16:09:50,431 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:54620 dest: /127.0.0.1:41648
2013-10-31 16:09:50,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:34585 dest: /127.0.0.1:38271
2013-10-31 16:09:50,434 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:34517 dest: /127.0.0.1:50942
2013-10-31 16:09:50,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-179423042782344656_1131 src: /127.0.0.1:47620 dest: /127.0.0.1:47311
2013-10-31 16:09:50,439 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47620, dest: /127.0.0.1:47311, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-179423042782344656_1131, duration: 93519
2013-10-31 16:09:50,440 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,440 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34517, dest: /127.0.0.1:50942, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-179423042782344656_1131, duration: 946768
2013-10-31 16:09:50,441 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,441 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34585, dest: /127.0.0.1:38271, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-179423042782344656_1131, duration: 1948361
2013-10-31 16:09:50,441 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,442 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,442 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54620, dest: /127.0.0.1:41648, bytes: 1722, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-179423042782344656_1131, duration: 2685288
2013-10-31 16:09:50,443 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-179423042782344656_1131 terminating
2013-10-31 16:09:50,445 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,445 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split from client DFSClient_1457307213
2013-10-31 16:09:50,446 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split is closed by DFSClient_1457307213
2013-10-31 16:09:50,446 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,447 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-179423042782344656_1131 size 1722
2013-10-31 16:09:50,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,468 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo. blk_-8375126459452884425_1132
2013-10-31 16:09:50,470 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8375126459452884425_1132 src: /127.0.0.1:34588 dest: /127.0.0.1:38271
2013-10-31 16:09:50,471 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8375126459452884425_1132 src: /127.0.0.1:47622 dest: /127.0.0.1:47311
2013-10-31 16:09:50,473 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8375126459452884425_1132 src: /127.0.0.1:54626 dest: /127.0.0.1:41648
2013-10-31 16:09:50,476 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54626, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8375126459452884425_1132, duration: 75715
2013-10-31 16:09:50,477 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8375126459452884425_1132 terminating
2013-10-31 16:09:50,477 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47622, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8375126459452884425_1132, duration: 893534
2013-10-31 16:09:50,478 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8375126459452884425_1132 terminating
2013-10-31 16:09:50,478 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34588, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8375126459452884425_1132, duration: 1926812
2013-10-31 16:09:50,479 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8375126459452884425_1132 size 183
2013-10-31 16:09:50,479 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8375126459452884425_1132 terminating
2013-10-31 16:09:50,480 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:09:50,481 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:09:50,481 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8375126459452884425_1132 size 183
2013-10-31 16:09:50,482 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8375126459452884425_1132 size 183
2013-10-31 16:09:50,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,509 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml. blk_-8922866185159813262_1133
2013-10-31 16:09:50,511 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8922866185159813262_1133 src: /127.0.0.1:34591 dest: /127.0.0.1:38271
2013-10-31 16:09:50,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8922866185159813262_1133 src: /127.0.0.1:54628 dest: /127.0.0.1:41648
2013-10-31 16:09:50,514 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8922866185159813262_1133 src: /127.0.0.1:47626 dest: /127.0.0.1:47311
2013-10-31 16:09:50,517 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47626, dest: /127.0.0.1:47311, bytes: 29848, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8922866185159813262_1133, duration: 104421
2013-10-31 16:09:50,517 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8922866185159813262_1133 terminating
2013-10-31 16:09:50,518 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54628, dest: /127.0.0.1:41648, bytes: 29848, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8922866185159813262_1133, duration: 941104
2013-10-31 16:09:50,519 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8922866185159813262_1133 size 29848
2013-10-31 16:09:50,519 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8922866185159813262_1133 terminating
2013-10-31 16:09:50,519 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8922866185159813262_1133 size 29848
2013-10-31 16:09:50,519 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34591, dest: /127.0.0.1:38271, bytes: 29848, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 2140751
2013-10-31 16:09:50,520 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8922866185159813262_1133 terminating
2013-10-31 16:09:50,521 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml from client DFSClient_1457307213
2013-10-31 16:09:50,522 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml is closed by DFSClient_1457307213
2013-10-31 16:09:50,523 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8922866185159813262_1133 size 29848
2013-10-31 16:09:50,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml dst=null perm=null
2013-10-31 16:09:50,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34595, bytes: 30084, op: HDFS_READ, cliID: DFSClient_319165589, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 404377
2013-10-31 16:09:50,556 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0012: nMaps=5 nReduces=1 max=-1
2013-10-31 16:09:50,556 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0012 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:09:50,556 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0012 RESULT=SUCCESS
2013-10-31 16:09:50,556 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0012
2013-10-31 16:09:50,556 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0012
2013-10-31 16:09:50,556 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0012
2013-10-31 16:09:50,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,582 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000002_0'
2013-10-31 16:09:50,583 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000003_0'
2013-10-31 16:09:50,587 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml. blk_147876096733075238_1135
2013-10-31 16:09:50,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_147876096733075238_1135 src: /127.0.0.1:47629 dest: /127.0.0.1:47311
2013-10-31 16:09:50,590 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_147876096733075238_1135 src: /127.0.0.1:54633 dest: /127.0.0.1:41648
2013-10-31 16:09:50,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_147876096733075238_1135 src: /127.0.0.1:34529 dest: /127.0.0.1:50942
2013-10-31 16:09:50,595 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34529, dest: /127.0.0.1:50942, bytes: 29913, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_147876096733075238_1135, duration: 691875
2013-10-31 16:09:50,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_147876096733075238_1135 terminating
2013-10-31 16:09:50,596 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_147876096733075238_1135 size 29913
2013-10-31 16:09:50,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54633, dest: /127.0.0.1:41648, bytes: 29913, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_147876096733075238_1135, duration: 1890132
2013-10-31 16:09:50,597 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_147876096733075238_1135 size 29913
2013-10-31 16:09:50,597 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_147876096733075238_1135 terminating
2013-10-31 16:09:50,597 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47629, dest: /127.0.0.1:47311, bytes: 29913, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_147876096733075238_1135, duration: 2447021
2013-10-31 16:09:50,598 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_147876096733075238_1135 size 29913
2013-10-31 16:09:50,598 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_147876096733075238_1135 terminating
2013-10-31 16:09:50,599 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml from client DFSClient_319165589
2013-10-31 16:09:50,600 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_conf.xml is closed by DFSClient_319165589
2013-10-31 16:09:50,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:09:50,613 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken. blk_2658578484986837675_1136
2013-10-31 16:09:50,614 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0011_m_000004_0'
2013-10-31 16:09:50,615 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2658578484986837675_1136 src: /127.0.0.1:34530 dest: /127.0.0.1:50942
2013-10-31 16:09:50,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2658578484986837675_1136 src: /127.0.0.1:34600 dest: /127.0.0.1:38271
2013-10-31 16:09:50,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2658578484986837675_1136 src: /127.0.0.1:54637 dest: /127.0.0.1:41648
2013-10-31 16:09:50,621 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54637, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2658578484986837675_1136, duration: 458717
2013-10-31 16:09:50,622 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2658578484986837675_1136 terminating
2013-10-31 16:09:50,622 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2658578484986837675_1136 size 116
2013-10-31 16:09:50,622 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34600, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2658578484986837675_1136, duration: 1224754
2013-10-31 16:09:50,623 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2658578484986837675_1136 size 116
2013-10-31 16:09:50,623 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2658578484986837675_1136 terminating
2013-10-31 16:09:50,623 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34530, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2658578484986837675_1136, duration: 2387328
2013-10-31 16:09:50,625 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2658578484986837675_1136 terminating
2013-10-31 16:09:50,627 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken from client DFSClient_1457307213
2013-10-31 16:09:50,628 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken is closed by DFSClient_1457307213
2013-10-31 16:09:50,628 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2658578484986837675_1136 size 116
2013-10-31 16:09:50,633 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken
2013-10-31 16:09:50,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.splitmetainfo dst=null perm=null
2013-10-31 16:09:50,637 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47635, bytes: 187, op: HDFS_READ, cliID: DFSClient_319165589, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8375126459452884425_1132, duration: 264141
2013-10-31 16:09:50,639 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0012 = 103. Number of splits = 5
2013-10-31 16:09:50,639 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,639 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,639 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,640 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,641 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0012_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:09:50,642 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0012 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:09:50,643 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0012 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:09:50,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5329221742438129426_1119 file build/test/data/dfs/data/data2/current/blk_-5329221742438129426 for deletion
2013-10-31 16:09:50,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2920999921881403397_1120 file build/test/data/dfs/data/data1/current/blk_-2920999921881403397 for deletion
2013-10-31 16:09:50,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5329221742438129426_1119 at file build/test/data/dfs/data/data2/current/blk_-5329221742438129426
2013-10-31 16:09:50,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data1/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:50,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2920999921881403397_1120 at file build/test/data/dfs/data/data1/current/blk_-2920999921881403397
2013-10-31 16:09:50,726 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data2/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:50,726 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data1/current/blk_-2068202829203503883
2013-10-31 16:09:50,726 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data2/current/blk_1251994781094396070
2013-10-31 16:09:50,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2920999921881403397_1120 file build/test/data/dfs/data/data8/current/blk_-2920999921881403397 for deletion
2013-10-31 16:09:50,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2068202829203503883_1118 file build/test/data/dfs/data/data7/current/blk_-2068202829203503883 for deletion
2013-10-31 16:09:50,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2920999921881403397_1120 at file build/test/data/dfs/data/data8/current/blk_-2920999921881403397
2013-10-31 16:09:50,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2068202829203503883_1118 at file build/test/data/dfs/data/data7/current/blk_-2068202829203503883
2013-10-31 16:09:50,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1251994781094396070_1117 file build/test/data/dfs/data/data7/current/blk_1251994781094396070 for deletion
2013-10-31 16:09:50,928 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1251994781094396070_1117 at file build/test/data/dfs/data/data7/current/blk_1251994781094396070
2013-10-31 16:09:51,212 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_145049323396269548_1130 to datanode(s) 127.0.0.1:41648
2013-10-31 16:09:51,212 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_8021674872422085597_1123
2013-10-31 16:09:51,212 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_8021674872422085597_1123
2013-10-31 16:09:51,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8021674872422085597_1123 file build/test/data/dfs/data/data4/current/blk_8021674872422085597 for deletion
2013-10-31 16:09:51,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8021674872422085597_1123 at file build/test/data/dfs/data/data4/current/blk_8021674872422085597
2013-10-31 16:09:52,588 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0012_m_000006_0' to tip task_20131031160444934_0012_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:52,593 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:09:52,594 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000006_0 which needs 1 slots
2013-10-31 16:09:52,594 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:52,594 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000006_0 which needs 1 slots
2013-10-31 16:09:52,594 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0011 being deleted.
2013-10-31 16:09:52,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken dst=null perm=null
2013-10-31 16:09:52,603 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54639, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2658578484986837675_1136, duration: 301515
2013-10-31 16:09:52,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml dst=null perm=null
2013-10-31 16:09:52,613 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34605, bytes: 30084, op: HDFS_READ, cliID: DFSClient_-1972287322, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 378227
2013-10-31 16:09:52,644 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:52,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar dst=null perm=null
2013-10-31 16:09:52,678 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47639, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1972287322, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_145049323396269548_1130, duration: 1621354
2013-10-31 16:09:52,776 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-2020008089
2013-10-31 16:09:52,777 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-2020008089 spawned.
2013-10-31 16:09:52,779 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000006_0/taskjvm.sh
2013-10-31 16:09:53,726 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_145049323396269548_1130 to 127.0.0.1:41648
2013-10-31 16:09:53,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_145049323396269548_1130 src: /127.0.0.1:54643 dest: /127.0.0.1:41648
2013-10-31 16:09:53,728 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_145049323396269548_1130 to /127.0.0.1:41648
2013-10-31 16:09:53,731 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_145049323396269548_1130 src: /127.0.0.1:54643 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:09:53,735 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_145049323396269548_1130 size 238055
2013-10-31 16:09:53,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8021674872422085597_1123 file build/test/data/dfs/data/data8/current/blk_8021674872422085597 for deletion
2013-10-31 16:09:53,928 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8021674872422085597_1123 at file build/test/data/dfs/data/data8/current/blk_8021674872422085597
2013-10-31 16:09:54,213 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_8021674872422085597_1123
2013-10-31 16:09:54,496 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-2020008089 given task: attempt_20131031160444934_0012_m_000006_0
2013-10-31 16:09:54,859 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:54,860 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000001_0 not found in cache
2013-10-31 16:09:54,860 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000000_0 not found in cache
2013-10-31 16:09:54,860 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000005_0 not found in cache
2013-10-31 16:09:54,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0011 for user-log deletion with retainTimeStamp:1383322194861
2013-10-31 16:09:55,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:09:55,283 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1944950700 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:55,293 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16118 with signal TERM. Exit code 0
2013-10-31 16:09:55,476 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1477786192 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:55,480 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:55,480 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:55,480 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:55,484 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16243 with signal TERM. Exit code 0
2013-10-31 16:09:55,484 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1944950700 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:55,583 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:55,584 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000003_0 not found in cache
2013-10-31 16:09:55,584 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000002_0 not found in cache
2013-10-31 16:09:55,585 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0011 for user-log deletion with retainTimeStamp:1383322195584
2013-10-31 16:09:55,615 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0011
2013-10-31 16:09:55,615 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0011_m_000004_0 not found in cache
2013-10-31 16:09:55,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0011 for user-log deletion with retainTimeStamp:1383322195616
2013-10-31 16:09:55,652 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:55,652 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:55,652 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:55,653 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1477786192 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:09:56,027 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1008552155 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:56,036 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16350 with signal TERM. Exit code 0
2013-10-31 16:09:56,077 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_448877274 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:56,077 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0011_m_-1264582295 since job job_20131031160444934_0011 is dead
2013-10-31 16:09:56,091 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16386 with signal TERM. Exit code 0
2013-10-31 16:09:56,091 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16387 with signal TERM. Exit code 0
2013-10-31 16:09:56,254 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:56,254 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:56,254 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:56,254 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1008552155 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:56,279 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:56,279 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:09:56,279 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:56,279 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:56,279 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:09:56,279 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_448877274 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:56,280 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:09:56,280 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0011_m_-1264582295 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:09:56,727 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8021674872422085597_1123 file build/test/data/dfs/data/data1/current/blk_8021674872422085597 for deletion
2013-10-31 16:09:56,727 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8021674872422085597_1123 at file build/test/data/dfs/data/data1/current/blk_8021674872422085597
2013-10-31 16:09:57,945 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000006_0 0.0% setup
2013-10-31 16:09:57,948 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000006_0 is done.
2013-10-31 16:09:57,948 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000006_0 was -1
2013-10-31 16:09:57,949 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:09:58,600 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000006_0' has completed task_20131031160444934_0012_m_000006 successfully.
2013-10-31 16:09:58,603 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000000_0' to tip task_20131031160444934_0012_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:58,604 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000000
2013-10-31 16:09:58,604 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000001_0' to tip task_20131031160444934_0012_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:09:58,605 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000001
2013-10-31 16:09:58,607 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:09:58,608 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:09:58,608 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000000_0 which needs 1 slots
2013-10-31 16:09:58,608 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000000_0 which needs 1 slots
2013-10-31 16:09:58,609 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000001_0 which needs 1 slots
2013-10-31 16:09:58,609 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0012_m_000001_0 which needs 1 slots
2013-10-31 16:09:58,656 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-1151686836
2013-10-31 16:09:58,657 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-1151686836 spawned.
2013-10-31 16:09:58,658 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0012/attempt_20131031160444934_0012_m_000001_0. Attempting to reuse: jvm_20131031160444934_0012_m_-2020008089
2013-10-31 16:09:58,659 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000000_0/taskjvm.sh
2013-10-31 16:09:58,869 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000002_0' to tip task_20131031160444934_0012_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:58,870 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000002
2013-10-31 16:09:58,870 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000003_0' to tip task_20131031160444934_0012_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:09:58,871 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000003
2013-10-31 16:09:58,872 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:09:58,872 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:09:58,872 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000002_0 which needs 1 slots
2013-10-31 16:09:58,872 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000002_0 which needs 1 slots
2013-10-31 16:09:58,873 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000003_0 which needs 1 slots
2013-10-31 16:09:58,873 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0012_m_000003_0 which needs 1 slots
2013-10-31 16:09:58,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken dst=null perm=null
2013-10-31 16:09:58,881 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34542, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2658578484986837675_1136, duration: 289092
2013-10-31 16:09:58,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml dst=null perm=null
2013-10-31 16:09:58,892 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54649, bytes: 30084, op: HDFS_READ, cliID: DFSClient_1709281947, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8922866185159813262_1133, duration: 385380
2013-10-31 16:09:58,906 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:58,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar dst=null perm=null
2013-10-31 16:09:58,920 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34545, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1709281947, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_145049323396269548_1130, duration: 664883
2013-10-31 16:09:58,973 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_1792759549
2013-10-31 16:09:58,974 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_1792759549 spawned.
2013-10-31 16:09:58,974 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-1393587902
2013-10-31 16:09:58,975 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-1393587902 spawned.
2013-10-31 16:09:58,976 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000003_0/taskjvm.sh
2013-10-31 16:09:58,976 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000002_0/taskjvm.sh
2013-10-31 16:09:59,007 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-2020008089 given task: attempt_20131031160444934_0012_m_000001_0
2013-10-31 16:09:59,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=null
2013-10-31 16:09:59,121 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34547, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-179423042782344656_1131, duration: 169255
2013-10-31 16:09:59,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:09:59,161 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34617, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 104879
2013-10-31 16:09:59,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=null
2013-10-31 16:09:59,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000 dst=null perm=null
2013-10-31 16:09:59,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001 dst=null perm=null
2013-10-31 16:09:59,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002 dst=null perm=null
2013-10-31 16:09:59,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003 dst=null perm=null
2013-10-31 16:09:59,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004 dst=null perm=null
2013-10-31 16:09:59,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000 dst=null perm=null
2013-10-31 16:09:59,475 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34619, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4463643465988243742_1125, duration: 141736
2013-10-31 16:09:59,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001 dst=null perm=null
2013-10-31 16:09:59,483 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34551, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2376389404784738128_1124, duration: 114004
2013-10-31 16:09:59,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002 dst=null perm=null
2013-10-31 16:09:59,486 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54657, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6334597591235643953_1128, duration: 104595
2013-10-31 16:09:59,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003 dst=null perm=null
2013-10-31 16:09:59,489 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34553, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7874678964818902618_1128, duration: 104699
2013-10-31 16:09:59,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004 dst=null perm=null
2013-10-31 16:09:59,492 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34554, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3681265296073978596_1128, duration: 100949
2013-10-31 16:09:59,585 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-1151686836 given task: attempt_20131031160444934_0012_m_000000_0
2013-10-31 16:09:59,591 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0012_m_000004_0' to tip task_20131031160444934_0012_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:09:59,592 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0012_m_000004
2013-10-31 16:09:59,592 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:09:59,593 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000004_0 which needs 1 slots
2013-10-31 16:09:59,593 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000004_0 which needs 1 slots
2013-10-31 16:09:59,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012/jobToken dst=null perm=null
2013-10-31 16:09:59,597 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34624, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2658578484986837675_1136, duration: 139720
2013-10-31 16:09:59,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.xml dst=null perm=null
2013-10-31 16:09:59,601 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34626, bytes: 30084, op: HDFS_READ, cliID: DFSClient_1501765769, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8922866185159813262_1133, duration: 166707
2013-10-31 16:09:59,614 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:09:59,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.jar dst=null perm=null
2013-10-31 16:09:59,628 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47660, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1501765769, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_145049323396269548_1130, duration: 661904
2013-10-31 16:09:59,682 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_m_-307168687
2013-10-31 16:09:59,682 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_m_-307168687 spawned.
2013-10-31 16:09:59,683 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_m_000004_0/taskjvm.sh
2013-10-31 16:10:00,040 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_1792759549 given task: attempt_20131031160444934_0012_m_000003_0
2013-10-31 16:10:00,061 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-1393587902 given task: attempt_20131031160444934_0012_m_000002_0
2013-10-31 16:10:00,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=null
2013-10-31 16:10:00,283 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34631, bytes: 1738, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-179423042782344656_1131, duration: 179847
2013-10-31 16:10:00,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:10:00,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=null
2013-10-31 16:10:00,541 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54670, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-179423042782344656_1131, duration: 170990
2013-10-31 16:10:00,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=null
2013-10-31 16:10:00,555 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54671, bytes: 1222, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-179423042782344656_1131, duration: 221742
2013-10-31 16:10:00,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:10:00,581 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34637, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 116372
2013-10-31 16:10:00,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:10:00,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=null
2013-10-31 16:10:00,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000 dst=null perm=null
2013-10-31 16:10:00,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001 dst=null perm=null
2013-10-31 16:10:00,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002 dst=null perm=null
2013-10-31 16:10:00,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003 dst=null perm=null
2013-10-31 16:10:00,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004 dst=null perm=null
2013-10-31 16:10:00,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00000 dst=null perm=null
2013-10-31 16:10:00,623 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54674, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4463643465988243742_1125, duration: 262158
2013-10-31 16:10:00,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00001 dst=null perm=null
2013-10-31 16:10:00,633 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47672, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2376389404784738128_1124, duration: 150126
2013-10-31 16:10:00,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00002 dst=null perm=null
2013-10-31 16:10:00,636 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34640, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6334597591235643953_1128, duration: 111844
2013-10-31 16:10:00,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00003 dst=null perm=null
2013-10-31 16:10:00,639 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34641, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7874678964818902618_1128, duration: 113088
2013-10-31 16:10:00,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787/part-00004 dst=null perm=null
2013-10-31 16:10:00,642 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47675, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3681265296073978596_1128, duration: 132033
2013-10-31 16:10:00,645 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54679, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 99026
2013-10-31 16:10:00,752 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-307168687 given task: attempt_20131031160444934_0012_m_000004_0
2013-10-31 16:10:00,851 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54681, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 138714
2013-10-31 16:10:01,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012/job.split dst=null perm=null
2013-10-31 16:10:01,873 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34578, bytes: 706, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-179423042782344656_1131, duration: 375099
2013-10-31 16:10:01,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:10:01,913 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47681, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0012_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 257682
2013-10-31 16:10:02,085 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:10:02,087 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000001_0 is done.
2013-10-31 16:10:02,087 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000001_0 was 264
2013-10-31 16:10:02,087 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:03,210 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:10:03,213 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000000_0 is done.
2013-10-31 16:10:03,213 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000000_0 was 307
2013-10-31 16:10:03,214 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:03,469 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:17+17
2013-10-31 16:10:03,471 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000003_0 is done.
2013-10-31 16:10:03,471 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000003_0 was 82
2013-10-31 16:10:03,472 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:03,484 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:0+17
2013-10-31 16:10:03,486 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000002_0 is done.
2013-10-31 16:10:03,487 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000002_0 was 101
2013-10-31 16:10:03,487 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:03,608 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0012_m_000006_0
2013-10-31 16:10:03,609 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0012_m_000006_0
2013-10-31 16:10:03,609 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0012_m_000006_0 not found in cache
2013-10-31 16:10:04,614 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000000_0' has completed task_20131031160444934_0012_m_000000 successfully.
2013-10-31 16:10:04,616 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000001_0' has completed task_20131031160444934_0012_m_000001 successfully.
2013-10-31 16:10:04,618 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0012_r_000000_0' to tip task_20131031160444934_0012_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:04,620 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:10:04,620 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_r_000000_0 which needs 1 slots
2013-10-31 16:10:04,621 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_r_000000_0 which needs 1 slots
2013-10-31 16:10:04,658 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0012_r_1984937276
2013-10-31 16:10:04,659 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0012_r_1984937276 spawned.
2013-10-31 16:10:04,660 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0012/attempt_20131031160444934_0012_r_000000_0/taskjvm.sh
2013-10-31 16:10:04,782 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt:34+17
2013-10-31 16:10:04,784 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000004_0 is done.
2013-10-31 16:10:04,785 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000004_0 was 82
2013-10-31 16:10:04,785 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:04,877 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000002_0' has completed task_20131031160444934_0012_m_000002 successfully.
2013-10-31 16:10:04,952 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000003_0' has completed task_20131031160444934_0012_m_000003 successfully.
2013-10-31 16:10:05,599 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000004_0' has completed task_20131031160444934_0012_m_000004 successfully.
2013-10-31 16:10:05,743 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_r_1984937276 given task: attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:11,402 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46375, bytes: 307, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000000_0, duration: 8883751
2013-10-31 16:10:11,427 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46375, bytes: 264, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000001_0, duration: 11545281
2013-10-31 16:10:11,445 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58308, bytes: 101, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000002_0, duration: 13342177
2013-10-31 16:10:11,462 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58309, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000003_0, duration: 11892076
2013-10-31 16:10:11,479 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42512, bytes: 82, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0012_m_000004_0, duration: 12354623
2013-10-31 16:10:12,223 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:12,266 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:12,327 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:12,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:12,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:12,593 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000. blk_6244668509629146044_1137
2013-10-31 16:10:12,616 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6244668509629146044_1137 src: /127.0.0.1:54691 dest: /127.0.0.1:41648
2013-10-31 16:10:12,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6244668509629146044_1137 src: /127.0.0.1:34587 dest: /127.0.0.1:50942
2013-10-31 16:10:12,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6244668509629146044_1137 src: /127.0.0.1:34657 dest: /127.0.0.1:38271
2013-10-31 16:10:12,626 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34657, dest: /127.0.0.1:38271, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0012_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6244668509629146044_1137, duration: 3386268
2013-10-31 16:10:12,627 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6244668509629146044_1137 terminating
2013-10-31 16:10:12,627 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34587, dest: /127.0.0.1:50942, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0012_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6244668509629146044_1137, duration: 1996397
2013-10-31 16:10:12,630 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6244668509629146044_1137 terminating
2013-10-31 16:10:12,631 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6244668509629146044_1137 size 592
2013-10-31 16:10:12,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54691, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0012_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6244668509629146044_1137, duration: 5619946
2013-10-31 16:10:12,631 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6244668509629146044_1137 size 592
2013-10-31 16:10:12,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6244668509629146044_1137 terminating
2013-10-31 16:10:12,636 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6244668509629146044_1137 size 592
2013-10-31 16:10:12,636 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:12,637 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:12,696 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0012_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:12,696 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:10:13,629 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0012_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:10:13,630 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:13,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0 dst=null perm=null
2013-10-31 16:10:13,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:13,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:13,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/_attempt_20131031160444934_0012_r_000000_0 dst=null perm=null
2013-10-31 16:10:15,285 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 1.0% reduce > reduce
2013-10-31 16:10:15,286 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_r_000000_0 1.0% reduce > reduce
2013-10-31 16:10:15,287 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_r_000000_0 is done.
2013-10-31 16:10:15,287 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_r_000000_0 was -1
2013-10-31 16:10:15,288 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:16,634 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_r_000000_0' has completed task_20131031160444934_0012_r_000000 successfully.
2013-10-31 16:10:16,639 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0012_m_000005_0' to tip task_20131031160444934_0012_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:16,643 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0012_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:10:16,643 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0012_m_000005_0 which needs 1 slots
2013-10-31 16:10:16,643 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0012_m_000005_0 which needs 1 slots
2013-10-31 16:10:16,679 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0012/attempt_20131031160444934_0012_m_000005_0. Attempting to reuse: jvm_20131031160444934_0012_m_-2020008089
2013-10-31 16:10:17,631 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0012_m_-2020008089 given task: attempt_20131031160444934_0012_m_000005_0
2013-10-31 16:10:17,735 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000005_0 0.0%
2013-10-31 16:10:17,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary dst=null perm=null
2013-10-31 16:10:17,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:17,758 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS from client DFSClient_attempt_20131031160444934_0012_m_000005_0
2013-10-31 16:10:17,758 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0012_m_000005_0
2013-10-31 16:10:17,765 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,766 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,766 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:17,766 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_145049323396269548 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,766 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,766 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,767 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,767 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-179423042782344656 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:17,767 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8375126459452884425 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,767 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8375126459452884425 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,768 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8375126459452884425 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,768 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8922866185159813262 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:17,768 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8922866185159813262 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:17,768 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8922866185159813262 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:17,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0012 dst=null perm=null
2013-10-31 16:10:18,217 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-179423042782344656_1131 blk_145049323396269548_1130
2013-10-31 16:10:18,217 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-8922866185159813262_1133 blk_-179423042782344656_1131 blk_145049323396269548_1130 blk_-8375126459452884425_1132
2013-10-31 16:10:18,334 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8922866185159813262_1133 file build/test/data/dfs/data/data3/current/blk_-8922866185159813262 for deletion
2013-10-31 16:10:18,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8375126459452884425_1132 file build/test/data/dfs/data/data4/current/blk_-8375126459452884425 for deletion
2013-10-31 16:10:18,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8922866185159813262_1133 at file build/test/data/dfs/data/data3/current/blk_-8922866185159813262
2013-10-31 16:10:18,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data3/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:18,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8375126459452884425_1132 at file build/test/data/dfs/data/data4/current/blk_-8375126459452884425
2013-10-31 16:10:18,336 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data3/current/blk_-179423042782344656
2013-10-31 16:10:18,336 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data4/current/blk_145049323396269548 for deletion
2013-10-31 16:10:18,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data4/current/blk_145049323396269548
2013-10-31 16:10:20,708 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0012_m_000005_0 0.0% cleanup
2013-10-31 16:10:20,709 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0012_m_000005_0 is done.
2013-10-31 16:10:20,709 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0012_m_000005_0 was -1
2013-10-31 16:10:20,710 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:20,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data8/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:20,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data7/current/blk_145049323396269548 for deletion
2013-10-31 16:10:20,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data8/current/blk_-179423042782344656
2013-10-31 16:10:20,938 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data7/current/blk_145049323396269548
2013-10-31 16:10:21,218 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8922866185159813262_1133 blk_-179423042782344656_1131 blk_145049323396269548_1130 blk_-8375126459452884425_1132
2013-10-31 16:10:21,218 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-8922866185159813262_1133 blk_-179423042782344656_1131 blk_145049323396269548_1130 blk_-8375126459452884425_1132
2013-10-31 16:10:21,643 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:21,644 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0012_r_000000_0
2013-10-31 16:10:21,948 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8922866185159813262_1133 file build/test/data/dfs/data/data6/current/blk_-8922866185159813262 for deletion
2013-10-31 16:10:21,948 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8375126459452884425_1132 file build/test/data/dfs/data/data5/current/blk_-8375126459452884425 for deletion
2013-10-31 16:10:21,948 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8922866185159813262_1133 at file build/test/data/dfs/data/data6/current/blk_-8922866185159813262
2013-10-31 16:10:21,948 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data6/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:21,948 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8375126459452884425_1132 at file build/test/data/dfs/data/data5/current/blk_-8375126459452884425
2013-10-31 16:10:21,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data6/current/blk_-179423042782344656
2013-10-31 16:10:21,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data5/current/blk_145049323396269548 for deletion
2013-10-31 16:10:21,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data5/current/blk_145049323396269548
2013-10-31 16:10:22,650 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0012_m_000005_0' has completed task_20131031160444934_0012_m_000005 successfully.
2013-10-31 16:10:22,651 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0012 has completed successfully.
2013-10-31 16:10:22,652 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0012,submitTime=1383235790530,launchTime=1383235790643,firstMapTaskLaunchTime=1383235798603,firstReduceTaskLaunchTime=1383235804617,firstJobSetupTaskLaunchTime=1383235792587,firstJobCleanupTaskLaunchTime=1383235816639,finishTime=1383235822651,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[C96242DE50E048DEA55073ACCDC74EF6/4C0776CD6B3444F6A475F3C309FA23DC] cogrouping/(1/2) ...tform/joinsintocogrouprhs
2013-10-31 16:10:22,658 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6. blk_2505685426499379044_1138
2013-10-31 16:10:22,662 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2505685426499379044_1138 src: /127.0.0.1:54698 dest: /127.0.0.1:41648
2013-10-31 16:10:22,665 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2505685426499379044_1138 src: /127.0.0.1:34594 dest: /127.0.0.1:50942
2013-10-31 16:10:22,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2505685426499379044_1138 src: /127.0.0.1:47697 dest: /127.0.0.1:47311
2013-10-31 16:10:22,675 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47697, dest: /127.0.0.1:47311, bytes: 32051, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2505685426499379044_1138, duration: 4774718
2013-10-31 16:10:22,676 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2505685426499379044_1138 terminating
2013-10-31 16:10:22,676 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34594, dest: /127.0.0.1:50942, bytes: 32051, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2505685426499379044_1138, duration: 5599676
2013-10-31 16:10:22,677 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2505685426499379044_1138 terminating
2013-10-31 16:10:22,677 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54698, dest: /127.0.0.1:41648, bytes: 32051, op: HDFS_WRITE, cliID: DFSClient_319165589, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2505685426499379044_1138, duration: 5786239
2013-10-31 16:10:22,677 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2505685426499379044_1138 terminating
2013-10-31 16:10:22,680 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2505685426499379044_1138 size 32051
2013-10-31 16:10:22,681 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6 from client DFSClient_319165589
2013-10-31 16:10:22,681 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_logs/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6 is closed by DFSClient_319165589
2013-10-31 16:10:22,681 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2505685426499379044_1138 size 32051
2013-10-31 16:10:22,682 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2505685426499379044_1138 size 32051
2013-10-31 16:10:22,690 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0012_1383235790530_hadoop_%5BC96242DE50E048DEA55073ACCDC74EF6%2F4C0776CD6B3444F6 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:22,691 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000000_0'
2013-10-31 16:10:22,691 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000001_0'
2013-10-31 16:10:22,692 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000005_0'
2013-10-31 16:10:22,693 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000006_0'
2013-10-31 16:10:22,693 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2658578484986837675 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,693 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_r_000000_0'
2013-10-31 16:10:22,693 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2658578484986837675 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,694 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2658578484986837675 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,697 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0012_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:22,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0012 dst=null perm=null
2013-10-31 16:10:22,701 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4928171777644314206 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,701 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4928171777644314206 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,701 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4928171777644314206 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,701 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4432548704645493821 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,702 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4432548704645493821 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,702 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4432548704645493821 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,702 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4463643465988243742 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,702 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4463643465988243742 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,703 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4463643465988243742 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,703 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2376389404784738128 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,703 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2376389404784738128 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,703 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2376389404784738128 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,704 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6334597591235643953 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,704 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6334597591235643953 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,704 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6334597591235643953 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:22,704 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7874678964818902618 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,704 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7874678964818902618 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,705 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7874678964818902618 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,705 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3681265296073978596 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:22,705 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3681265296073978596 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:22,705 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3681265296073978596 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:22,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8671927566_lower_upper_E74809F0B9AF4841BACA9F47ADCCA787 dst=null perm=null
2013-10-31 16:10:22,714 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary
2013-10-31 16:10:22,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2013-10-31 16:10:22,734 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:22,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2013-10-31 16:10:22,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2013-10-31 16:10:22,738 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54702, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6244668509629146044_1137, duration: 174105
2013-10-31 16:10:22,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2013-10-31 16:10:22,746 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:22,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2013-10-31 16:10:22,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2013-10-31 16:10:22,749 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34598, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6244668509629146044_1137, duration: 417798
2013-10-31 16:10:22,750 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogrouprhs
2013-10-31 16:10:22,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2013-10-31 16:10:22,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2013-10-31 16:10:22,756 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34599, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6244668509629146044_1137, duration: 389969
2013-10-31 16:10:22,869 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:10:22,869 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:10:22,885 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:10:22,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:10:22,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:10:22,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher"]
2013-10-31 16:10:22,887 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:10:22,887 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:10:22,887 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:10:22,888 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...dpipesplatform/joinhasher
2013-10-31 16:10:22,891 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:10:22,891 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:10:22,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:22,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:10:22,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:22,922 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar. blk_2084801281739929944_1139
2013-10-31 16:10:22,924 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:54705 dest: /127.0.0.1:41648
2013-10-31 16:10:22,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:34670 dest: /127.0.0.1:38271
2013-10-31 16:10:22,927 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:47704 dest: /127.0.0.1:47311
2013-10-31 16:10:22,942 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47704, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2084801281739929944_1139, duration: 11522713
2013-10-31 16:10:22,943 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2084801281739929944_1139 terminating
2013-10-31 16:10:22,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34670, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2084801281739929944_1139, duration: 12738970
2013-10-31 16:10:22,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2084801281739929944_1139 terminating
2013-10-31 16:10:22,944 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54705, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2084801281739929944_1139, duration: 13924284
2013-10-31 16:10:22,945 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2084801281739929944_1139 terminating
2013-10-31 16:10:22,945 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:22,948 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar from client DFSClient_1457307213
2013-10-31 16:10:22,948 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar is closed by DFSClient_1457307213
2013-10-31 16:10:22,949 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:22,949 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:22,964 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar. New replication is 10
2013-10-31 16:10:22,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar dst=null perm=null
2013-10-31 16:10:22,973 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000002_0'
2013-10-31 16:10:22,974 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000003_0'
2013-10-31 16:10:22,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:22,975 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:10:22,980 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:22,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:23,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,477 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split. New replication is 10
2013-10-31 16:10:23,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=null
2013-10-31 16:10:23,484 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split. blk_-608843021333253453_1140
2013-10-31 16:10:23,485 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:47705 dest: /127.0.0.1:47311
2013-10-31 16:10:23,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:34604 dest: /127.0.0.1:50942
2013-10-31 16:10:23,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:34674 dest: /127.0.0.1:38271
2013-10-31 16:10:23,490 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-608843021333253453_1140 src: /127.0.0.1:54711 dest: /127.0.0.1:41648
2013-10-31 16:10:23,494 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54711, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-608843021333253453_1140, duration: 102979
2013-10-31 16:10:23,494 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,494 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,494 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34674, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-608843021333253453_1140, duration: 897360
2013-10-31 16:10:23,495 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,495 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,496 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34604, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-608843021333253453_1140, duration: 2080171
2013-10-31 16:10:23,496 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,496 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47705, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-608843021333253453_1140, duration: 2996561
2013-10-31 16:10:23,497 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-608843021333253453_1140 terminating
2013-10-31 16:10:23,498 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,499 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split from client DFSClient_1457307213
2013-10-31 16:10:23,499 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split is closed by DFSClient_1457307213
2013-10-31 16:10:23,500 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-608843021333253453_1140 size 1732
2013-10-31 16:10:23,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,516 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo. blk_3386068009123988079_1141
2013-10-31 16:10:23,517 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3386068009123988079_1141 src: /127.0.0.1:34676 dest: /127.0.0.1:38271
2013-10-31 16:10:23,519 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3386068009123988079_1141 src: /127.0.0.1:47710 dest: /127.0.0.1:47311
2013-10-31 16:10:23,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3386068009123988079_1141 src: /127.0.0.1:34609 dest: /127.0.0.1:50942
2013-10-31 16:10:23,524 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34609, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3386068009123988079_1141, duration: 65885
2013-10-31 16:10:23,524 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3386068009123988079_1141 terminating
2013-10-31 16:10:23,524 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47710, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3386068009123988079_1141, duration: 829930
2013-10-31 16:10:23,525 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3386068009123988079_1141 terminating
2013-10-31 16:10:23,525 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3386068009123988079_1141 size 183
2013-10-31 16:10:23,525 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34676, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3386068009123988079_1141, duration: 1664939
2013-10-31 16:10:23,526 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3386068009123988079_1141 size 183
2013-10-31 16:10:23,527 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3386068009123988079_1141 terminating
2013-10-31 16:10:23,529 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:10:23,530 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:10:23,530 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3386068009123988079_1141 size 183
2013-10-31 16:10:23,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:23,560 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml. blk_1041963905236869909_1142
2013-10-31 16:10:23,561 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1041963905236869909_1142 src: /127.0.0.1:34610 dest: /127.0.0.1:50942
2013-10-31 16:10:23,563 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1041963905236869909_1142 src: /127.0.0.1:54716 dest: /127.0.0.1:41648
2013-10-31 16:10:23,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1041963905236869909_1142 src: /127.0.0.1:47714 dest: /127.0.0.1:47311
2013-10-31 16:10:23,567 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47714, dest: /127.0.0.1:47311, bytes: 28715, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1041963905236869909_1142, duration: 88149
2013-10-31 16:10:23,567 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1041963905236869909_1142 terminating
2013-10-31 16:10:23,568 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54716, dest: /127.0.0.1:41648, bytes: 28715, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 831431
2013-10-31 16:10:23,568 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1041963905236869909_1142 terminating
2013-10-31 16:10:23,569 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34610, dest: /127.0.0.1:50942, bytes: 28715, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1041963905236869909_1142, duration: 1668963
2013-10-31 16:10:23,569 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1041963905236869909_1142 terminating
2013-10-31 16:10:23,571 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1041963905236869909_1142 size 28715
2013-10-31 16:10:23,572 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1041963905236869909_1142 size 28715
2013-10-31 16:10:23,572 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1041963905236869909_1142 size 28715
2013-10-31 16:10:23,620 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0012_m_000004_0'
2013-10-31 16:10:23,646 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:23,647 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0012 being deleted.
2013-10-31 16:10:23,736 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8922866185159813262_1133 file build/test/data/dfs/data/data2/current/blk_-8922866185159813262 for deletion
2013-10-31 16:10:23,736 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8375126459452884425_1132 file build/test/data/dfs/data/data1/current/blk_-8375126459452884425 for deletion
2013-10-31 16:10:23,736 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8922866185159813262_1133 at file build/test/data/dfs/data/data2/current/blk_-8922866185159813262
2013-10-31 16:10:23,736 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-179423042782344656_1131 file build/test/data/dfs/data/data2/current/blk_-179423042782344656 for deletion
2013-10-31 16:10:23,737 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8375126459452884425_1132 at file build/test/data/dfs/data/data1/current/blk_-8375126459452884425
2013-10-31 16:10:23,737 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-179423042782344656_1131 at file build/test/data/dfs/data/data2/current/blk_-179423042782344656
2013-10-31 16:10:23,737 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_145049323396269548_1130 file build/test/data/dfs/data/data1/current/blk_145049323396269548 for deletion
2013-10-31 16:10:23,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_145049323396269548_1130 at file build/test/data/dfs/data/data1/current/blk_145049323396269548
2013-10-31 16:10:23,971 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml from client DFSClient_1457307213
2013-10-31 16:10:23,972 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml is closed by DFSClient_1457307213
2013-10-31 16:10:23,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml dst=null perm=null
2013-10-31 16:10:23,987 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54719, bytes: 28943, op: HDFS_READ, cliID: DFSClient_710295022, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 389093
2013-10-31 16:10:24,006 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0013: nMaps=5 nReduces=0 max=-1
2013-10-31 16:10:24,006 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0013 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:10:24,006 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0013
2013-10-31 16:10:24,007 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0013 RESULT=SUCCESS
2013-10-31 16:10:24,007 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0013
2013-10-31 16:10:24,009 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0013
2013-10-31 16:10:24,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:24,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:24,039 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml. blk_-1501954730110881669_1144
2013-10-31 16:10:24,041 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1501954730110881669_1144 src: /127.0.0.1:34615 dest: /127.0.0.1:50942
2013-10-31 16:10:24,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1501954730110881669_1144 src: /127.0.0.1:47718 dest: /127.0.0.1:47311
2013-10-31 16:10:24,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1501954730110881669_1144 src: /127.0.0.1:54722 dest: /127.0.0.1:41648
2013-10-31 16:10:24,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54722, dest: /127.0.0.1:41648, bytes: 28780, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1501954730110881669_1144, duration: 624861
2013-10-31 16:10:24,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1501954730110881669_1144 terminating
2013-10-31 16:10:24,049 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47718, dest: /127.0.0.1:47311, bytes: 28780, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1501954730110881669_1144, duration: 1904708
2013-10-31 16:10:24,049 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1501954730110881669_1144 terminating
2013-10-31 16:10:24,050 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34615, dest: /127.0.0.1:50942, bytes: 28780, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1501954730110881669_1144, duration: 2302329
2013-10-31 16:10:24,050 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1501954730110881669_1144 terminating
2013-10-31 16:10:24,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1501954730110881669_1144 size 28780
2013-10-31 16:10:24,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1501954730110881669_1144 size 28780
2013-10-31 16:10:24,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1501954730110881669_1144 size 28780
2013-10-31 16:10:24,219 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_2084801281739929944_1139 to datanode(s) 127.0.0.1:50942
2013-10-31 16:10:24,219 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_4928171777644314206_1129 blk_2658578484986837675_1136 blk_-4432548704645493821_1122 blk_4463643465988243742_1125 blk_6334597591235643953_1128
2013-10-31 16:10:24,220 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-2376389404784738128_1124 blk_4928171777644314206_1129 blk_2658578484986837675_1136 blk_-4432548704645493821_1122 blk_-3681265296073978596_1128 blk_-7874678964818902618_1128 blk_6334597591235643953_1128
2013-10-31 16:10:24,335 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_2084801281739929944_1139 to 127.0.0.1:50942
2013-10-31 16:10:24,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2084801281739929944_1139 src: /127.0.0.1:34618 dest: /127.0.0.1:50942
2013-10-31 16:10:24,338 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_2084801281739929944_1139 to /127.0.0.1:50942
2013-10-31 16:10:24,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_2084801281739929944_1139 src: /127.0.0.1:34618 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:10:24,345 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2084801281739929944_1139 size 238055
2013-10-31 16:10:24,452 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml from client DFSClient_710295022
2013-10-31 16:10:24,453 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_conf.xml is closed by DFSClient_710295022
2013-10-31 16:10:24,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:24,467 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken. blk_-6351416155261990527_1145
2013-10-31 16:10:24,468 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6351416155261990527_1145 src: /127.0.0.1:47721 dest: /127.0.0.1:47311
2013-10-31 16:10:24,470 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6351416155261990527_1145 src: /127.0.0.1:34689 dest: /127.0.0.1:38271
2013-10-31 16:10:24,471 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6351416155261990527_1145 src: /127.0.0.1:34621 dest: /127.0.0.1:50942
2013-10-31 16:10:24,474 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34621, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6351416155261990527_1145, duration: 65254
2013-10-31 16:10:24,474 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6351416155261990527_1145 terminating
2013-10-31 16:10:24,475 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34689, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6351416155261990527_1145, duration: 843190
2013-10-31 16:10:24,475 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6351416155261990527_1145 terminating
2013-10-31 16:10:24,476 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47721, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6351416155261990527_1145, duration: 1689699
2013-10-31 16:10:24,477 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6351416155261990527_1145 terminating
2013-10-31 16:10:24,477 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6351416155261990527_1145 size 116
2013-10-31 16:10:24,479 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken from client DFSClient_1457307213
2013-10-31 16:10:24,479 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken is closed by DFSClient_1457307213
2013-10-31 16:10:24,479 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6351416155261990527_1145 size 116
2013-10-31 16:10:24,480 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6351416155261990527_1145 size 116
2013-10-31 16:10:24,483 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken
2013-10-31 16:10:24,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.splitmetainfo dst=null perm=null
2013-10-31 16:10:24,487 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47724, bytes: 187, op: HDFS_READ, cliID: DFSClient_710295022, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3386068009123988079_1141, duration: 262562
2013-10-31 16:10:24,489 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0013 = 19. Number of splits = 5
2013-10-31 16:10:24,489 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,489 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,490 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,491 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,492 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0013_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:24,493 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0013 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:10:24,493 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0013 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:10:24,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4432548704645493821_1122 file build/test/data/dfs/data/data6/current/blk_-4432548704645493821 for deletion
2013-10-31 16:10:24,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2658578484986837675_1136 file build/test/data/dfs/data/data6/current/blk_2658578484986837675 for deletion
2013-10-31 16:10:24,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4432548704645493821_1122 at file build/test/data/dfs/data/data6/current/blk_-4432548704645493821
2013-10-31 16:10:24,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4463643465988243742_1125 file build/test/data/dfs/data/data5/current/blk_4463643465988243742 for deletion
2013-10-31 16:10:24,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2658578484986837675_1136 at file build/test/data/dfs/data/data6/current/blk_2658578484986837675
2013-10-31 16:10:24,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4928171777644314206_1129 file build/test/data/dfs/data/data5/current/blk_4928171777644314206 for deletion
2013-10-31 16:10:24,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4463643465988243742_1125 at file build/test/data/dfs/data/data5/current/blk_4463643465988243742
2013-10-31 16:10:24,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6334597591235643953_1128 file build/test/data/dfs/data/data6/current/blk_6334597591235643953 for deletion
2013-10-31 16:10:24,951 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4928171777644314206_1129 at file build/test/data/dfs/data/data5/current/blk_4928171777644314206
2013-10-31 16:10:24,951 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6334597591235643953_1128 at file build/test/data/dfs/data/data6/current/blk_6334597591235643953
2013-10-31 16:10:25,698 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0013_m_000006_0' to tip task_20131031160444934_0013_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:25,704 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:10:25,704 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000006_0 which needs 1 slots
2013-10-31 16:10:25,704 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000006_0 which needs 1 slots
2013-10-31 16:10:25,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken dst=null perm=null
2013-10-31 16:10:25,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34623, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6351416155261990527_1145, duration: 293552
2013-10-31 16:10:25,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml dst=null perm=null
2013-10-31 16:10:25,723 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54730, bytes: 28943, op: HDFS_READ, cliID: DFSClient_253800261, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 391575
2013-10-31 16:10:25,772 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:25,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar dst=null perm=null
2013-10-31 16:10:25,806 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54731, bytes: 239915, op: HDFS_READ, cliID: DFSClient_253800261, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2084801281739929944_1139, duration: 1330924
2013-10-31 16:10:25,903 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0012_m_-1151686836
2013-10-31 16:10:25,909 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16862 with signal TERM. Exit code 0
2013-10-31 16:10:25,909 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_-954554037
2013-10-31 16:10:25,910 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_-954554037 spawned.
2013-10-31 16:10:25,911 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000006_0/taskjvm.sh
2013-10-31 16:10:25,995 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:25,995 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:25,995 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:25,995 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-1151686836 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:26,939 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7874678964818902618_1128 file build/test/data/dfs/data/data7/current/blk_-7874678964818902618 for deletion
2013-10-31 16:10:26,939 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4432548704645493821_1122 file build/test/data/dfs/data/data7/current/blk_-4432548704645493821 for deletion
2013-10-31 16:10:26,939 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7874678964818902618_1128 at file build/test/data/dfs/data/data7/current/blk_-7874678964818902618
2013-10-31 16:10:26,939 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3681265296073978596_1128 file build/test/data/dfs/data/data8/current/blk_-3681265296073978596 for deletion
2013-10-31 16:10:26,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4432548704645493821_1122 at file build/test/data/dfs/data/data7/current/blk_-4432548704645493821
2013-10-31 16:10:26,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2376389404784738128_1124 file build/test/data/dfs/data/data8/current/blk_-2376389404784738128 for deletion
2013-10-31 16:10:26,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3681265296073978596_1128 at file build/test/data/dfs/data/data8/current/blk_-3681265296073978596
2013-10-31 16:10:26,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2658578484986837675_1136 file build/test/data/dfs/data/data8/current/blk_2658578484986837675 for deletion
2013-10-31 16:10:26,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2376389404784738128_1124 at file build/test/data/dfs/data/data8/current/blk_-2376389404784738128
2013-10-31 16:10:26,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4928171777644314206_1129 file build/test/data/dfs/data/data8/current/blk_4928171777644314206 for deletion
2013-10-31 16:10:26,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2658578484986837675_1136 at file build/test/data/dfs/data/data8/current/blk_2658578484986837675
2013-10-31 16:10:26,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6334597591235643953_1128 file build/test/data/dfs/data/data7/current/blk_6334597591235643953 for deletion
2013-10-31 16:10:26,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4928171777644314206_1129 at file build/test/data/dfs/data/data8/current/blk_4928171777644314206
2013-10-31 16:10:26,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6334597591235643953_1128 at file build/test/data/dfs/data/data7/current/blk_6334597591235643953
2013-10-31 16:10:27,220 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-2376389404784738128_1124 blk_4928171777644314206_1129 blk_-3681265296073978596_1128 blk_-7874678964818902618_1128 blk_4463643465988243742_1125
2013-10-31 16:10:27,220 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-2376389404784738128_1124 blk_2658578484986837675_1136 blk_-4432548704645493821_1122 blk_-3681265296073978596_1128 blk_-7874678964818902618_1128 blk_4463643465988243742_1125 blk_6334597591235643953_1128
2013-10-31 16:10:27,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7874678964818902618_1128 file build/test/data/dfs/data/data3/current/blk_-7874678964818902618 for deletion
2013-10-31 16:10:27,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3681265296073978596_1128 file build/test/data/dfs/data/data4/current/blk_-3681265296073978596 for deletion
2013-10-31 16:10:27,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7874678964818902618_1128 at file build/test/data/dfs/data/data3/current/blk_-7874678964818902618
2013-10-31 16:10:27,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3681265296073978596_1128 at file build/test/data/dfs/data/data4/current/blk_-3681265296073978596
2013-10-31 16:10:27,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2376389404784738128_1124 file build/test/data/dfs/data/data3/current/blk_-2376389404784738128 for deletion
2013-10-31 16:10:27,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4463643465988243742_1125 file build/test/data/dfs/data/data4/current/blk_4463643465988243742 for deletion
2013-10-31 16:10:27,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2376389404784738128_1124 at file build/test/data/dfs/data/data3/current/blk_-2376389404784738128
2013-10-31 16:10:27,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4928171777644314206_1129 file build/test/data/dfs/data/data3/current/blk_4928171777644314206 for deletion
2013-10-31 16:10:27,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4463643465988243742_1125 at file build/test/data/dfs/data/data4/current/blk_4463643465988243742
2013-10-31 16:10:27,339 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4928171777644314206_1129 at file build/test/data/dfs/data/data3/current/blk_4928171777644314206
2013-10-31 16:10:27,538 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-954554037 given task: attempt_20131031160444934_0013_m_000006_0
2013-10-31 16:10:27,694 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:27,694 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0012_m_000005_0 not found in cache
2013-10-31 16:10:27,695 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0012 for user-log deletion with retainTimeStamp:1383322227695
2013-10-31 16:10:27,823 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_r_1984937276 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:27,827 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17166 with signal TERM. Exit code 0
2013-10-31 16:10:27,974 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:27,974 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:27,974 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:27,974 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_r_1984937276 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:27,974 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:27,975 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0012 for user-log deletion with retainTimeStamp:1383322227975
2013-10-31 16:10:28,051 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_1792759549 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:28,058 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16926 with signal TERM. Exit code 0
2013-10-31 16:10:28,060 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_-1393587902 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:28,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:28,065 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16956 with signal TERM. Exit code 0
2013-10-31 16:10:28,262 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:28,262 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:28,263 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:28,263 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:28,262 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:28,263 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:28,263 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_1792759549 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:28,264 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-1393587902 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:28,621 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0012
2013-10-31 16:10:28,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0012 for user-log deletion with retainTimeStamp:1383322228621
2013-10-31 16:10:28,739 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_-2020008089 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:28,749 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16682 with signal TERM. Exit code 0
2013-10-31 16:10:28,941 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:28,941 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:28,941 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:28,941 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-2020008089 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:10:29,528 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0012_m_-307168687 since job job_20131031160444934_0012 is dead
2013-10-31 16:10:29,538 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17027 with signal TERM. Exit code 0
2013-10-31 16:10:29,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7874678964818902618_1128 file build/test/data/dfs/data/data2/current/blk_-7874678964818902618 for deletion
2013-10-31 16:10:29,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4432548704645493821_1122 file build/test/data/dfs/data/data2/current/blk_-4432548704645493821 for deletion
2013-10-31 16:10:29,738 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7874678964818902618_1128 at file build/test/data/dfs/data/data2/current/blk_-7874678964818902618
2013-10-31 16:10:29,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3681265296073978596_1128 file build/test/data/dfs/data/data1/current/blk_-3681265296073978596 for deletion
2013-10-31 16:10:29,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4432548704645493821_1122 at file build/test/data/dfs/data/data2/current/blk_-4432548704645493821
2013-10-31 16:10:29,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2376389404784738128_1124 file build/test/data/dfs/data/data2/current/blk_-2376389404784738128 for deletion
2013-10-31 16:10:29,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3681265296073978596_1128 at file build/test/data/dfs/data/data1/current/blk_-3681265296073978596
2013-10-31 16:10:29,740 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2376389404784738128_1124 at file build/test/data/dfs/data/data2/current/blk_-2376389404784738128
2013-10-31 16:10:29,739 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2658578484986837675_1136 file build/test/data/dfs/data/data1/current/blk_2658578484986837675 for deletion
2013-10-31 16:10:29,740 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4463643465988243742_1125 file build/test/data/dfs/data/data1/current/blk_4463643465988243742 for deletion
2013-10-31 16:10:29,740 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2658578484986837675_1136 at file build/test/data/dfs/data/data1/current/blk_2658578484986837675
2013-10-31 16:10:29,740 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6334597591235643953_1128 file build/test/data/dfs/data/data2/current/blk_6334597591235643953 for deletion
2013-10-31 16:10:29,741 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4463643465988243742_1125 at file build/test/data/dfs/data/data1/current/blk_4463643465988243742
2013-10-31 16:10:29,741 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6334597591235643953_1128 at file build/test/data/dfs/data/data2/current/blk_6334597591235643953
2013-10-31 16:10:29,777 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:29,777 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:29,777 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:29,777 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0012_m_-307168687 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:30,991 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000006_0 0.0% setup
2013-10-31 16:10:30,993 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000006_0 is done.
2013-10-31 16:10:30,994 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000006_0 was -1
2013-10-31 16:10:30,994 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:31,710 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000006_0' has completed task_20131031160444934_0013_m_000006 successfully.
2013-10-31 16:10:31,714 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000000_0' to tip task_20131031160444934_0013_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:31,715 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000000
2013-10-31 16:10:31,716 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000001_0' to tip task_20131031160444934_0013_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:31,716 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000001
2013-10-31 16:10:31,718 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:10:31,719 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:10:31,719 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000000_0 which needs 1 slots
2013-10-31 16:10:31,720 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000000_0 which needs 1 slots
2013-10-31 16:10:31,720 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000001_0 which needs 1 slots
2013-10-31 16:10:31,720 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0013_m_000001_0 which needs 1 slots
2013-10-31 16:10:31,759 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_1014058939
2013-10-31 16:10:31,760 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_1014058939 spawned.
2013-10-31 16:10:31,761 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000000_0/taskjvm.sh
2013-10-31 16:10:31,765 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0013/attempt_20131031160444934_0013_m_000001_0. Attempting to reuse: jvm_20131031160444934_0013_m_-954554037
2013-10-31 16:10:31,981 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000002_0' to tip task_20131031160444934_0013_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:31,981 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000002
2013-10-31 16:10:31,981 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000003_0' to tip task_20131031160444934_0013_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:31,981 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000003
2013-10-31 16:10:31,982 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:10:31,984 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:10:31,984 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000002_0 which needs 1 slots
2013-10-31 16:10:31,984 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000002_0 which needs 1 slots
2013-10-31 16:10:31,984 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000003_0 which needs 1 slots
2013-10-31 16:10:31,984 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0013_m_000003_0 which needs 1 slots
2013-10-31 16:10:31,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken dst=null perm=null
2013-10-31 16:10:31,992 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34699, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6351416155261990527_1145, duration: 291395
2013-10-31 16:10:31,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml dst=null perm=null
2013-10-31 16:10:32,002 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47734, bytes: 28943, op: HDFS_READ, cliID: DFSClient_1455276149, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1041963905236869909_1142, duration: 368995
2013-10-31 16:10:32,022 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:32,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar dst=null perm=null
2013-10-31 16:10:32,035 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54738, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1455276149, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2084801281739929944_1139, duration: 709650
2013-10-31 16:10:32,089 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_299302560
2013-10-31 16:10:32,089 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_299302560 spawned.
2013-10-31 16:10:32,089 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_-544706238
2013-10-31 16:10:32,090 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_-544706238 spawned.
2013-10-31 16:10:32,091 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000002_0/taskjvm.sh
2013-10-31 16:10:32,091 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000003_0/taskjvm.sh
2013-10-31 16:10:32,108 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-954554037 given task: attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:32,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=null
2013-10-31 16:10:32,211 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47737, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-608843021333253453_1140, duration: 166598
2013-10-31 16:10:32,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:32,252 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34705, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 127301
2013-10-31 16:10:32,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:32,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:32,620 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_1014058939 given task: attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:32,629 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0013_m_000004_0' to tip task_20131031160444934_0013_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:10:32,629 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0013_m_000004
2013-10-31 16:10:32,630 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:10:32,630 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000004_0 which needs 1 slots
2013-10-31 16:10:32,630 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000004_0 which needs 1 slots
2013-10-31 16:10:32,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013/jobToken dst=null perm=null
2013-10-31 16:10:32,634 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47740, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6351416155261990527_1145, duration: 142931
2013-10-31 16:10:32,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.xml dst=null perm=null
2013-10-31 16:10:32,639 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54745, bytes: 28943, op: HDFS_READ, cliID: DFSClient_-1738923227, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1041963905236869909_1142, duration: 153238
2013-10-31 16:10:32,652 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:32,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.jar dst=null perm=null
2013-10-31 16:10:32,666 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34641, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1738923227, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2084801281739929944_1139, duration: 634064
2013-10-31 16:10:32,736 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_-28830232
2013-10-31 16:10:32,737 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_-28830232 spawned.
2013-10-31 16:10:32,739 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000004_0/taskjvm.sh
2013-10-31 16:10:33,101 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_299302560 given task: attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:33,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:33,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:33,118 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34644, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 136022
2013-10-31 16:10:33,127 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001. blk_-8296089989830320846_1146
2013-10-31 16:10:33,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8296089989830320846_1146 src: /127.0.0.1:54751 dest: /127.0.0.1:41648
2013-10-31 16:10:33,143 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8296089989830320846_1146 src: /127.0.0.1:34647 dest: /127.0.0.1:50942
2013-10-31 16:10:33,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8296089989830320846_1146 src: /127.0.0.1:34717 dest: /127.0.0.1:38271
2013-10-31 16:10:33,146 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34717, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8296089989830320846_1146, duration: 1810427
2013-10-31 16:10:33,147 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8296089989830320846_1146 terminating
2013-10-31 16:10:33,147 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34647, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8296089989830320846_1146, duration: 2077904
2013-10-31 16:10:33,147 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8296089989830320846_1146 terminating
2013-10-31 16:10:33,147 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8296089989830320846_1146 size 8
2013-10-31 16:10:33,147 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54751, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8296089989830320846_1146, duration: 2696287
2013-10-31 16:10:33,148 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8296089989830320846_1146 terminating
2013-10-31 16:10:33,149 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:33,150 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:33,151 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8296089989830320846_1146 size 8
2013-10-31 16:10:33,152 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8296089989830320846_1146 size 8
2013-10-31 16:10:33,187 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:33,187 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000001_0 0.0%
2013-10-31 16:10:33,189 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-544706238 given task: attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:33,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=null
2013-10-31 16:10:33,214 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54754, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-608843021333253453_1140, duration: 162637
2013-10-31 16:10:33,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:33,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:33,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:33,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=null
2013-10-31 16:10:33,615 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34725, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-608843021333253453_1140, duration: 174883
2013-10-31 16:10:33,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:33,655 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34726, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 137357
2013-10-31 16:10:33,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:33,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=null
2013-10-31 16:10:33,687 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34658, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-608843021333253453_1140, duration: 157146
2013-10-31 16:10:33,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:33,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:33,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34728, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 129650
2013-10-31 16:10:33,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:33,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:33,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:33,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:33,766 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47762, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 128730
2013-10-31 16:10:33,768 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34661, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 102135
2013-10-31 16:10:33,775 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000. blk_-8480038614496047175_1149
2013-10-31 16:10:33,777 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_-28830232 given task: attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:33,796 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8480038614496047175_1149 src: /127.0.0.1:34731 dest: /127.0.0.1:38271
2013-10-31 16:10:33,797 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8480038614496047175_1149 src: /127.0.0.1:54768 dest: /127.0.0.1:41648
2013-10-31 16:10:33,798 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8480038614496047175_1149 src: /127.0.0.1:47766 dest: /127.0.0.1:47311
2013-10-31 16:10:33,800 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47766, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8480038614496047175_1149, duration: 1293267
2013-10-31 16:10:33,800 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8480038614496047175_1149 terminating
2013-10-31 16:10:33,800 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8480038614496047175_1149 size 8
2013-10-31 16:10:33,800 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54768, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8480038614496047175_1149, duration: 1545845
2013-10-31 16:10:33,801 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8480038614496047175_1149 size 8
2013-10-31 16:10:33,801 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8480038614496047175_1149 terminating
2013-10-31 16:10:33,801 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34731, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8480038614496047175_1149, duration: 1979264
2013-10-31 16:10:33,801 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8480038614496047175_1149 terminating
2013-10-31 16:10:33,802 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:33,802 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:33,804 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8480038614496047175_1149 size 8
2013-10-31 16:10:33,847 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:33,847 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000000_0 0.0%
2013-10-31 16:10:34,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:34,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:34,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47767, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 143944
2013-10-31 16:10:34,184 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002. blk_5790387209777498875_1149
2013-10-31 16:10:34,206 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5790387209777498875_1149 src: /127.0.0.1:34666 dest: /127.0.0.1:50942
2013-10-31 16:10:34,207 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5790387209777498875_1149 src: /127.0.0.1:47770 dest: /127.0.0.1:47311
2013-10-31 16:10:34,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5790387209777498875_1149 src: /127.0.0.1:54774 dest: /127.0.0.1:41648
2013-10-31 16:10:34,211 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54774, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5790387209777498875_1149, duration: 2112653
2013-10-31 16:10:34,211 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5790387209777498875_1149 terminating
2013-10-31 16:10:34,211 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47770, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5790387209777498875_1149, duration: 2350066
2013-10-31 16:10:34,211 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5790387209777498875_1149 terminating
2013-10-31 16:10:34,211 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34666, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5790387209777498875_1149, duration: 2745536
2013-10-31 16:10:34,212 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5790387209777498875_1149 terminating
2013-10-31 16:10:34,214 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5790387209777498875_1149 size 8
2013-10-31 16:10:34,214 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5790387209777498875_1149 size 8
2013-10-31 16:10:34,216 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5790387209777498875_1149 size 8
2013-10-31 16:10:34,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:34,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:34,235 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34670, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 116252
2013-10-31 16:10:34,244 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003. blk_-4333307790222333982_1149
2013-10-31 16:10:34,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4333307790222333982_1149 src: /127.0.0.1:34671 dest: /127.0.0.1:50942
2013-10-31 16:10:34,265 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4333307790222333982_1149 src: /127.0.0.1:34741 dest: /127.0.0.1:38271
2013-10-31 16:10:34,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4333307790222333982_1149 src: /127.0.0.1:54778 dest: /127.0.0.1:41648
2013-10-31 16:10:34,268 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54778, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4333307790222333982_1149, duration: 917796
2013-10-31 16:10:34,268 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4333307790222333982_1149 terminating
2013-10-31 16:10:34,268 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34741, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4333307790222333982_1149, duration: 1260866
2013-10-31 16:10:34,269 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4333307790222333982_1149 terminating
2013-10-31 16:10:34,269 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34671, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4333307790222333982_1149, duration: 1694495
2013-10-31 16:10:34,269 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4333307790222333982_1149 terminating
2013-10-31 16:10:34,271 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4333307790222333982_1149 size 8
2013-10-31 16:10:34,271 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4333307790222333982_1149 size 8
2013-10-31 16:10:34,272 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4333307790222333982_1149 size 8
2013-10-31 16:10:34,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013/job.split dst=null perm=null
2013-10-31 16:10:34,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34674, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-608843021333253453_1140, duration: 150915
2013-10-31 16:10:34,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:34,320 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47777, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 251846
2013-10-31 16:10:34,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:34,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:34,614 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:34,614 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:34,661 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:34,662 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000002_0 0.0%
2013-10-31 16:10:34,670 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:34,671 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:34,720 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000000_0
2013-10-31 16:10:34,720 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000001_0
2013-10-31 16:10:34,726 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:34,726 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000003_0 0.0%
2013-10-31 16:10:34,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:34,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:34,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0 dst=null perm=null
2013-10-31 16:10:34,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:34,855 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34676, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 145990
2013-10-31 16:10:34,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:34,864 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004. blk_-3746207844407953251_1150
2013-10-31 16:10:34,886 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3746207844407953251_1150 src: /127.0.0.1:34746 dest: /127.0.0.1:38271
2013-10-31 16:10:34,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3746207844407953251_1150 src: /127.0.0.1:34678 dest: /127.0.0.1:50942
2013-10-31 16:10:34,889 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3746207844407953251_1150 src: /127.0.0.1:54784 dest: /127.0.0.1:41648
2013-10-31 16:10:34,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54784, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3746207844407953251_1150, duration: 1533507
2013-10-31 16:10:34,892 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3746207844407953251_1150 terminating
2013-10-31 16:10:34,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34678, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3746207844407953251_1150, duration: 1534014
2013-10-31 16:10:34,893 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3746207844407953251_1150 size 8
2013-10-31 16:10:34,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3746207844407953251_1150 terminating
2013-10-31 16:10:34,893 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34746, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0013_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3746207844407953251_1150, duration: 2509870
2013-10-31 16:10:34,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3746207844407953251_1150 terminating
2013-10-31 16:10:34,895 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:34,895 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:34,895 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3746207844407953251_1150 size 8
2013-10-31 16:10:34,897 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3746207844407953251_1150 size 8
2013-10-31 16:10:34,987 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000002_0
2013-10-31 16:10:34,988 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000003_0
2013-10-31 16:10:36,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0 dst=null perm=null
2013-10-31 16:10:36,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0 dst=null perm=null
2013-10-31 16:10:36,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:36,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:36,720 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0013_m_000006_0
2013-10-31 16:10:36,720 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0013_m_000006_0
2013-10-31 16:10:36,720 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000006_0 not found in cache
2013-10-31 16:10:37,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0 dst=null perm=null
2013-10-31 16:10:37,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:37,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000000_0 dst=null perm=null
2013-10-31 16:10:37,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:37,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:37,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:37,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000003_0 dst=null perm=null
2013-10-31 16:10:37,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000001_0 dst=null perm=null
2013-10-31 16:10:37,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000002_0 dst=null perm=null
2013-10-31 16:10:37,528 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0013_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:10:37,529 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000004_0 0.0%
2013-10-31 16:10:38,207 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:10:38,210 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:10:38,210 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000001_0 is done.
2013-10-31 16:10:38,211 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000001_0 was -1
2013-10-31 16:10:38,211 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:38,637 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0013_m_000004_0
2013-10-31 16:10:39,177 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:10:39,181 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:10:39,182 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000000_0 is done.
2013-10-31 16:10:39,182 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000000_0 was -1
2013-10-31 16:10:39,183 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:39,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0 dst=null perm=null
2013-10-31 16:10:39,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:39,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:39,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary/_attempt_20131031160444934_0013_m_000004_0 dst=null perm=null
2013-10-31 16:10:39,591 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:10:39,594 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:10:39,595 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000002_0 is done.
2013-10-31 16:10:39,595 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000002_0 was -1
2013-10-31 16:10:39,595 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:10:39,655 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:10:39,658 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:10:39,659 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000003_0 is done.
2013-10-31 16:10:39,659 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000003_0 was -1
2013-10-31 16:10:39,660 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:39,848 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:10:39,858 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,863 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,869 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,874 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,879 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:10:39,885 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:10:40,254 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:10:40,256 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:10:40,257 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000004_0 is done.
2013-10-31 16:10:40,257 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000004_0 was -1
2013-10-31 16:10:40,258 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:40,726 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000000_0' has completed task_20131031160444934_0013_m_000000 successfully.
2013-10-31 16:10:40,728 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000001_0' has completed task_20131031160444934_0013_m_000001 successfully.
2013-10-31 16:10:40,995 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000002_0' has completed task_20131031160444934_0013_m_000002 successfully.
2013-10-31 16:10:40,996 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000003_0' has completed task_20131031160444934_0013_m_000003 successfully.
2013-10-31 16:10:41,009 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 109 raw values into 2 aggregated values, total 2
2013-10-31 16:10:41,641 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000004_0' has completed task_20131031160444934_0013_m_000004 successfully.
2013-10-31 16:10:41,645 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0013_m_000005_0' to tip task_20131031160444934_0013_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:10:41,647 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0013_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:10:41,648 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0013_m_000005_0 which needs 1 slots
2013-10-31 16:10:41,648 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0013_m_000005_0 which needs 1 slots
2013-10-31 16:10:41,682 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0013_m_1197284086
2013-10-31 16:10:41,683 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0013_m_1197284086 spawned.
2013-10-31 16:10:41,685 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0013/attempt_20131031160444934_0013_m_000005_0/taskjvm.sh
2013-10-31 16:10:43,318 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0013_m_1197284086 given task: attempt_20131031160444934_0013_m_000005_0
2013-10-31 16:10:43,825 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000005_0 0.0%
2013-10-31 16:10:43,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary dst=null perm=null
2013-10-31 16:10:43,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:43,844 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_SUCCESS from client DFSClient_attempt_20131031160444934_0013_m_000005_0
2013-10-31 16:10:43,844 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0013_m_000005_0
2013-10-31 16:10:43,848 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,848 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:43,848 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:43,848 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2084801281739929944 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,848 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:43,848 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:43,848 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,849 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-608843021333253453 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,849 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3386068009123988079 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,849 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3386068009123988079 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,849 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3386068009123988079 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:43,849 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1041963905236869909 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:43,849 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1041963905236869909 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:10:43,849 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1041963905236869909 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:43,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0013 dst=null perm=null
2013-10-31 16:10:45,223 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_1041963905236869909_1142
2013-10-31 16:10:45,224 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_1041963905236869909_1142 blk_3386068009123988079_1141
2013-10-31 16:10:45,956 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data5/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:45,956 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1041963905236869909_1142 file build/test/data/dfs/data/data6/current/blk_1041963905236869909 for deletion
2013-10-31 16:10:45,956 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data5/current/blk_-608843021333253453
2013-10-31 16:10:45,956 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data6/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:45,957 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1041963905236869909_1142 at file build/test/data/dfs/data/data6/current/blk_1041963905236869909
2013-10-31 16:10:45,957 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data6/current/blk_2084801281739929944
2013-10-31 16:10:46,759 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0013_m_000005_0 0.0% cleanup
2013-10-31 16:10:46,761 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0013_m_000005_0 is done.
2013-10-31 16:10:46,761 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0013_m_000005_0 was -1
2013-10-31 16:10:46,762 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:47,654 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0013_m_000005_0' has completed task_20131031160444934_0013_m_000005 successfully.
2013-10-31 16:10:47,656 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0013 has completed successfully.
2013-10-31 16:10:47,656 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0013,submitTime=1383235823977,launchTime=1383235824493,firstMapTaskLaunchTime=1383235831713,firstJobSetupTaskLaunchTime=1383235825698,firstJobCleanupTaskLaunchTime=1383235841645,finishTime=1383235847656,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[AB177B931712472A8AB9B4D226E53A7C/AF81984FA2F142A0B8BE2298DF2AFB05] lower*upper/(1/1) ...dpipesplatform/joinhasher
2013-10-31 16:10:47,675 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0. blk_-7665853369446340265_1151
2013-10-31 16:10:47,677 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7665853369446340265_1151 src: /127.0.0.1:54788 dest: /127.0.0.1:41648
2013-10-31 16:10:47,679 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7665853369446340265_1151 src: /127.0.0.1:47786 dest: /127.0.0.1:47311
2013-10-31 16:10:47,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7665853369446340265_1151 src: /127.0.0.1:34685 dest: /127.0.0.1:50942
2013-10-31 16:10:47,690 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34685, dest: /127.0.0.1:50942, bytes: 26349, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7665853369446340265_1151, duration: 5755147
2013-10-31 16:10:47,691 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7665853369446340265_1151 terminating
2013-10-31 16:10:47,691 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47786, dest: /127.0.0.1:47311, bytes: 26349, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7665853369446340265_1151, duration: 4900001
2013-10-31 16:10:47,692 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7665853369446340265_1151 terminating
2013-10-31 16:10:47,692 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54788, dest: /127.0.0.1:41648, bytes: 26349, op: HDFS_WRITE, cliID: DFSClient_710295022, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7665853369446340265_1151, duration: 7547819
2013-10-31 16:10:47,693 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7665853369446340265_1151 terminating
2013-10-31 16:10:47,697 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7665853369446340265_1151 size 26349
2013-10-31 16:10:47,699 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0 from client DFSClient_710295022
2013-10-31 16:10:47,700 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_logs/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0 is closed by DFSClient_710295022
2013-10-31 16:10:47,700 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7665853369446340265_1151 size 26349
2013-10-31 16:10:47,700 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7665853369446340265_1151 size 26349
2013-10-31 16:10:47,709 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0013_1383235823977_hadoop_%5BAB177B931712472A8AB9B4D226E53A7C%2FAF81984FA2F142A0 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:47,709 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000004_0'
2013-10-31 16:10:47,710 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000005_0'
2013-10-31 16:10:47,712 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6351416155261990527 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:10:47,712 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6351416155261990527 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:10:47,712 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:47,712 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0013 being deleted.
2013-10-31 16:10:47,712 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6351416155261990527 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:10:47,715 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0013_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:10:47,719 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/_temporary
2013-10-31 16:10:47,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0013 dst=null perm=null
2013-10-31 16:10:47,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=null
2013-10-31 16:10:47,777 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:10:47,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2013-10-31 16:10:47,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2013-10-31 16:10:47,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2013-10-31 16:10:47,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2013-10-31 16:10:47,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2013-10-31 16:10:47,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2013-10-31 16:10:47,787 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34756, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8480038614496047175_1149, duration: 280883
2013-10-31 16:10:47,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2013-10-31 16:10:47,790 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54793, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8296089989830320846_1146, duration: 267484
2013-10-31 16:10:47,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2013-10-31 16:10:47,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47791, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5790387209777498875_1149, duration: 257272
2013-10-31 16:10:47,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2013-10-31 16:10:47,796 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54795, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4333307790222333982_1149, duration: 254656
2013-10-31 16:10:47,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2013-10-31 16:10:47,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54796, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3746207844407953251_1150, duration: 255471
2013-10-31 16:10:47,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=null
2013-10-31 16:10:47,816 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:10:47,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2013-10-31 16:10:47,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2013-10-31 16:10:47,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2013-10-31 16:10:47,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2013-10-31 16:10:47,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2013-10-31 16:10:47,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2013-10-31 16:10:47,824 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47794, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8480038614496047175_1149, duration: 132314
2013-10-31 16:10:47,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2013-10-31 16:10:47,826 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34762, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8296089989830320846_1146, duration: 269391
2013-10-31 16:10:47,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2013-10-31 16:10:47,828 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54799, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5790387209777498875_1149, duration: 262408
2013-10-31 16:10:47,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2013-10-31 16:10:47,831 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34695, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4333307790222333982_1149, duration: 294700
2013-10-31 16:10:47,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2013-10-31 16:10:47,833 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54801, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3746207844407953251_1150, duration: 261105
2013-10-31 16:10:47,833 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinhasher
2013-10-31 16:10:47,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher dst=null perm=null
2013-10-31 16:10:47,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2013-10-31 16:10:47,840 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54802, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8480038614496047175_1149, duration: 256935
2013-10-31 16:10:47,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2013-10-31 16:10:47,844 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34698, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8296089989830320846_1146, duration: 253547
2013-10-31 16:10:47,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2013-10-31 16:10:47,849 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54804, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5790387209777498875_1149, duration: 269599
2013-10-31 16:10:47,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2013-10-31 16:10:47,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34700, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4333307790222333982_1149, duration: 273098
2013-10-31 16:10:47,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2013-10-31 16:10:47,858 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34701, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3746207844407953251_1150, duration: 262836
2013-10-31 16:10:47,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:47,872 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt. blk_-5586763943079904199_1152
2013-10-31 16:10:47,874 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5586763943079904199_1152 src: /127.0.0.1:47804 dest: /127.0.0.1:47311
2013-10-31 16:10:47,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5586763943079904199_1152 src: /127.0.0.1:34772 dest: /127.0.0.1:38271
2013-10-31 16:10:47,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5586763943079904199_1152 src: /127.0.0.1:34704 dest: /127.0.0.1:50942
2013-10-31 16:10:47,878 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34704, dest: /127.0.0.1:50942, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5586763943079904199_1152, duration: 650806
2013-10-31 16:10:47,878 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5586763943079904199_1152 terminating
2013-10-31 16:10:47,878 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34772, dest: /127.0.0.1:38271, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5586763943079904199_1152, duration: 1007285
2013-10-31 16:10:47,879 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5586763943079904199_1152 terminating
2013-10-31 16:10:47,879 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47804, dest: /127.0.0.1:47311, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5586763943079904199_1152, duration: 1042254
2013-10-31 16:10:47,879 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5586763943079904199_1152 terminating
2013-10-31 16:10:47,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5586763943079904199_1152 size 30
2013-10-31 16:10:47,880 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt from client DFSClient_1457307213
2013-10-31 16:10:47,881 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt is closed by DFSClient_1457307213
2013-10-31 16:10:47,881 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5586763943079904199_1152 size 30
2013-10-31 16:10:47,882 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5586763943079904199_1152 size 30
2013-10-31 16:10:47,894 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:10:47,895 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:10:47,915 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] starting
2013-10-31 16:10:47,916 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:10:47,916 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt"]
2013-10-31 16:10:47,916 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:10:47,917 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin"]
2013-10-31 16:10:47,917 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] parallel execution is enabled: true
2013-10-31 16:10:47,917 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] starting jobs: 2
2013-10-31 16:10:47,917 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper*joined] allocating threads: 2
2013-10-31 16:10:47,919 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] starting step: (2/2)
2013-10-31 16:10:47,922 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:10:47,922 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:10:47,946 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data7/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:47,946 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1041963905236869909_1142 file build/test/data/dfs/data/data7/current/blk_1041963905236869909 for deletion
2013-10-31 16:10:47,946 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data7/current/blk_-608843021333253453
2013-10-31 16:10:47,946 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data7/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:47,947 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1041963905236869909_1142 at file build/test/data/dfs/data/data7/current/blk_1041963905236869909
2013-10-31 16:10:47,947 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3386068009123988079_1141 file build/test/data/dfs/data/data8/current/blk_3386068009123988079 for deletion
2013-10-31 16:10:47,947 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data7/current/blk_2084801281739929944
2013-10-31 16:10:47,947 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3386068009123988079_1141 at file build/test/data/dfs/data/data8/current/blk_3386068009123988079
2013-10-31 16:10:48,224 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_-6351416155261990527_1145 blk_1041963905236869909_1142 blk_3386068009123988079_1141
2013-10-31 16:10:48,224 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_2084801281739929944_1139 blk_-608843021333253453_1140 blk_-6351416155261990527_1145 blk_3386068009123988079_1141
2013-10-31 16:10:48,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:48,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:10:48,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,320 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar. blk_3145602704174950073_1153
2013-10-31 16:10:48,322 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:34774 dest: /127.0.0.1:38271
2013-10-31 16:10:48,323 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:54811 dest: /127.0.0.1:41648
2013-10-31 16:10:48,325 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:47809 dest: /127.0.0.1:47311
2013-10-31 16:10:48,336 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47809, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3145602704174950073_1153, duration: 7874231
2013-10-31 16:10:48,337 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3145602704174950073_1153 terminating
2013-10-31 16:10:48,337 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54811, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3145602704174950073_1153, duration: 8606367
2013-10-31 16:10:48,338 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3145602704174950073_1153 terminating
2013-10-31 16:10:48,338 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:48,338 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34774, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3145602704174950073_1153, duration: 9580497
2013-10-31 16:10:48,339 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3145602704174950073_1153 terminating
2013-10-31 16:10:48,342 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:48,342 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar from client DFSClient_1457307213
2013-10-31 16:10:48,343 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar is closed by DFSClient_1457307213
2013-10-31 16:10:48,343 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:48,344 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6351416155261990527_1145 file build/test/data/dfs/data/data3/current/blk_-6351416155261990527 for deletion
2013-10-31 16:10:48,345 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data3/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:48,345 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6351416155261990527_1145 at file build/test/data/dfs/data/data3/current/blk_-6351416155261990527
2013-10-31 16:10:48,345 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1041963905236869909_1142 file build/test/data/dfs/data/data3/current/blk_1041963905236869909 for deletion
2013-10-31 16:10:48,345 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data3/current/blk_-608843021333253453
2013-10-31 16:10:48,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data4/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:48,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1041963905236869909_1142 at file build/test/data/dfs/data/data3/current/blk_1041963905236869909
2013-10-31 16:10:48,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3386068009123988079_1141 file build/test/data/dfs/data/data4/current/blk_3386068009123988079 for deletion
2013-10-31 16:10:48,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data4/current/blk_2084801281739929944
2013-10-31 16:10:48,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3386068009123988079_1141 at file build/test/data/dfs/data/data4/current/blk_3386068009123988079
2013-10-31 16:10:48,349 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar. New replication is 10
2013-10-31 16:10:48,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar dst=null perm=null
2013-10-31 16:10:48,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,369 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:10:48,373 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:10:48,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:48,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,390 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split. New replication is 10
2013-10-31 16:10:48,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=null
2013-10-31 16:10:48,398 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split. blk_362137174242859386_1154
2013-10-31 16:10:48,400 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:34708 dest: /127.0.0.1:50942
2013-10-31 16:10:48,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:47811 dest: /127.0.0.1:47311
2013-10-31 16:10:48,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:34779 dest: /127.0.0.1:38271
2013-10-31 16:10:48,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_362137174242859386_1154 src: /127.0.0.1:54816 dest: /127.0.0.1:41648
2013-10-31 16:10:48,408 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54816, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_362137174242859386_1154, duration: 86598
2013-10-31 16:10:48,408 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,409 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34779, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_362137174242859386_1154, duration: 856869
2013-10-31 16:10:48,409 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,410 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47811, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_362137174242859386_1154, duration: 1834822
2013-10-31 16:10:48,410 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,410 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,411 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34708, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_362137174242859386_1154, duration: 2905762
2013-10-31 16:10:48,411 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,411 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_362137174242859386_1154 terminating
2013-10-31 16:10:48,413 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,413 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split from client DFSClient_1457307213
2013-10-31 16:10:48,414 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split is closed by DFSClient_1457307213
2013-10-31 16:10:48,415 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_362137174242859386_1154 size 1732
2013-10-31 16:10:48,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,436 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo. blk_-7737511616191737526_1155
2013-10-31 16:10:48,437 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7737511616191737526_1155 src: /127.0.0.1:54817 dest: /127.0.0.1:41648
2013-10-31 16:10:48,439 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7737511616191737526_1155 src: /127.0.0.1:34713 dest: /127.0.0.1:50942
2013-10-31 16:10:48,441 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7737511616191737526_1155 src: /127.0.0.1:34783 dest: /127.0.0.1:38271
2013-10-31 16:10:48,444 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34783, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7737511616191737526_1155, duration: 59409
2013-10-31 16:10:48,444 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7737511616191737526_1155 terminating
2013-10-31 16:10:48,445 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34713, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7737511616191737526_1155, duration: 775350
2013-10-31 16:10:48,445 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7737511616191737526_1155 terminating
2013-10-31 16:10:48,445 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54817, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7737511616191737526_1155, duration: 1556588
2013-10-31 16:10:48,445 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7737511616191737526_1155 size 183
2013-10-31 16:10:48,446 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7737511616191737526_1155 terminating
2013-10-31 16:10:48,449 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:10:48,450 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:10:48,450 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7737511616191737526_1155 size 183
2013-10-31 16:10:48,451 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7737511616191737526_1155 size 183
2013-10-31 16:10:48,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,475 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml. blk_7152624195160131338_1156
2013-10-31 16:10:48,476 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7152624195160131338_1156 src: /127.0.0.1:34784 dest: /127.0.0.1:38271
2013-10-31 16:10:48,478 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7152624195160131338_1156 src: /127.0.0.1:34716 dest: /127.0.0.1:50942
2013-10-31 16:10:48,480 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7152624195160131338_1156 src: /127.0.0.1:47819 dest: /127.0.0.1:47311
2013-10-31 16:10:48,483 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47819, dest: /127.0.0.1:47311, bytes: 28811, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7152624195160131338_1156, duration: 226572
2013-10-31 16:10:48,483 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7152624195160131338_1156 terminating
2013-10-31 16:10:48,483 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34716, dest: /127.0.0.1:50942, bytes: 28811, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 1101591
2013-10-31 16:10:48,484 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7152624195160131338_1156 terminating
2013-10-31 16:10:48,484 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34784, dest: /127.0.0.1:38271, bytes: 28811, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7152624195160131338_1156, duration: 1951015
2013-10-31 16:10:48,485 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7152624195160131338_1156 terminating
2013-10-31 16:10:48,487 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7152624195160131338_1156 size 28811
2013-10-31 16:10:48,487 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml from client DFSClient_1457307213
2013-10-31 16:10:48,487 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml is closed by DFSClient_1457307213
2013-10-31 16:10:48,488 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7152624195160131338_1156 size 28811
2013-10-31 16:10:48,488 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7152624195160131338_1156 size 28811
2013-10-31 16:10:48,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml dst=null perm=null
2013-10-31 16:10:48,503 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34719, bytes: 29039, op: HDFS_READ, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 402421
2013-10-31 16:10:48,522 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0014: nMaps=5 nReduces=1 max=-1
2013-10-31 16:10:48,523 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0014 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:10:48,523 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0014
2013-10-31 16:10:48,523 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0014 RESULT=SUCCESS
2013-10-31 16:10:48,523 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0014
2013-10-31 16:10:48,525 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] submitted hadoop job: job_20131031160444934_0014
2013-10-31 16:10:48,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:48,557 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml. blk_-8751337026572452485_1158
2013-10-31 16:10:48,559 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8751337026572452485_1158 src: /127.0.0.1:34720 dest: /127.0.0.1:50942
2013-10-31 16:10:48,560 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8751337026572452485_1158 src: /127.0.0.1:47823 dest: /127.0.0.1:47311
2013-10-31 16:10:48,562 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8751337026572452485_1158 src: /127.0.0.1:54827 dest: /127.0.0.1:41648
2013-10-31 16:10:48,583 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54827, dest: /127.0.0.1:41648, bytes: 28876, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8751337026572452485_1158, duration: 92458
2013-10-31 16:10:48,583 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8751337026572452485_1158 terminating
2013-10-31 16:10:48,587 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47823, dest: /127.0.0.1:47311, bytes: 28876, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8751337026572452485_1158, duration: 1861906
2013-10-31 16:10:48,590 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8751337026572452485_1158 terminating
2013-10-31 16:10:48,590 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8751337026572452485_1158 size 28876
2013-10-31 16:10:48,590 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34720, dest: /127.0.0.1:50942, bytes: 28876, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8751337026572452485_1158, duration: 7760462
2013-10-31 16:10:48,592 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8751337026572452485_1158 terminating
2013-10-31 16:10:48,594 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8751337026572452485_1158 size 28876
2013-10-31 16:10:48,596 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml from client DFSClient_1152728397
2013-10-31 16:10:48,596 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_conf.xml is closed by DFSClient_1152728397
2013-10-31 16:10:48,597 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8751337026572452485_1158 size 28876
2013-10-31 16:10:49,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:10:49,097 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken. blk_7144251647658547015_1159
2013-10-31 16:10:49,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7144251647658547015_1159 src: /127.0.0.1:34723 dest: /127.0.0.1:50942
2013-10-31 16:10:49,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7144251647658547015_1159 src: /127.0.0.1:34793 dest: /127.0.0.1:38271
2013-10-31 16:10:49,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7144251647658547015_1159 src: /127.0.0.1:54830 dest: /127.0.0.1:41648
2013-10-31 16:10:49,105 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54830, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7144251647658547015_1159, duration: 65574
2013-10-31 16:10:49,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7144251647658547015_1159 terminating
2013-10-31 16:10:49,106 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34793, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 838380
2013-10-31 16:10:49,107 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7144251647658547015_1159 terminating
2013-10-31 16:10:49,107 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7144251647658547015_1159 size 116
2013-10-31 16:10:49,107 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34723, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7144251647658547015_1159, duration: 1784166
2013-10-31 16:10:49,108 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7144251647658547015_1159 size 116
2013-10-31 16:10:49,108 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7144251647658547015_1159 terminating
2013-10-31 16:10:49,110 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken from client DFSClient_1457307213
2013-10-31 16:10:49,111 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken is closed by DFSClient_1457307213
2013-10-31 16:10:49,112 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7144251647658547015_1159 size 116
2013-10-31 16:10:49,117 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken
2013-10-31 16:10:49,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.splitmetainfo dst=null perm=null
2013-10-31 16:10:49,121 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54831, bytes: 187, op: HDFS_READ, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7737511616191737526_1155, duration: 276415
2013-10-31 16:10:49,122 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0014 = 19. Number of splits = 5
2013-10-31 16:10:49,122 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,123 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,124 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,125 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,126 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0014_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:10:49,126 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0014 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:10:49,127 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0014 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:10:49,739 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0014_m_000006_0' to tip task_20131031160444934_0014_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:49,743 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000000_0'
2013-10-31 16:10:49,744 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000001_0'
2013-10-31 16:10:49,744 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000006_0'
2013-10-31 16:10:49,745 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:10:49,746 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000006_0 which needs 1 slots
2013-10-31 16:10:49,746 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000006_0 which needs 1 slots
2013-10-31 16:10:49,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken dst=null perm=null
2013-10-31 16:10:49,754 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34796, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 281591
2013-10-31 16:10:49,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml dst=null perm=null
2013-10-31 16:10:49,764 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34729, bytes: 29039, op: HDFS_READ, cliID: DFSClient_-1506749740, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 381902
2013-10-31 16:10:49,795 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:49,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar dst=null perm=null
2013-10-31 16:10:49,826 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47832, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1506749740, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3145602704174950073_1153, duration: 1419539
2013-10-31 16:10:49,923 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0013_m_-954554037
2013-10-31 16:10:49,930 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17387 with signal TERM. Exit code 0
2013-10-31 16:10:49,930 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-1305407431
2013-10-31 16:10:49,931 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-1305407431 spawned.
2013-10-31 16:10:49,932 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000006_0/taskjvm.sh
2013-10-31 16:10:50,009 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000002_0'
2013-10-31 16:10:50,009 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0013_m_000003_0'
2013-10-31 16:10:50,156 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:50,156 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:50,156 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:50,156 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_-954554037 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:10:50,744 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6351416155261990527_1145 file build/test/data/dfs/data/data2/current/blk_-6351416155261990527 for deletion
2013-10-31 16:10:50,745 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-608843021333253453_1140 file build/test/data/dfs/data/data2/current/blk_-608843021333253453 for deletion
2013-10-31 16:10:50,745 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6351416155261990527_1145 at file build/test/data/dfs/data/data2/current/blk_-6351416155261990527
2013-10-31 16:10:50,745 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2084801281739929944_1139 file build/test/data/dfs/data/data1/current/blk_2084801281739929944 for deletion
2013-10-31 16:10:50,745 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-608843021333253453_1140 at file build/test/data/dfs/data/data2/current/blk_-608843021333253453
2013-10-31 16:10:50,745 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3386068009123988079_1141 file build/test/data/dfs/data/data1/current/blk_3386068009123988079 for deletion
2013-10-31 16:10:50,745 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2084801281739929944_1139 at file build/test/data/dfs/data/data1/current/blk_2084801281739929944
2013-10-31 16:10:50,745 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3386068009123988079_1141 at file build/test/data/dfs/data/data1/current/blk_3386068009123988079
2013-10-31 16:10:50,938 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1305407431 given task: attempt_20131031160444934_0014_m_000006_0
2013-10-31 16:10:51,225 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_3145602704174950073_1153 to datanode(s) 127.0.0.1:50942
2013-10-31 16:10:51,225 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-6351416155261990527_1145
2013-10-31 16:10:51,441 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 847 Total time for transactions(ms): 16Number of transactions batched in Syncs: 80 Number of syncs: 600 SyncTimes(ms): 25189 3180
2013-10-31 16:10:51,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:10:52,712 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:52,712 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000004_0 not found in cache
2013-10-31 16:10:52,712 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000005_0 not found in cache
2013-10-31 16:10:52,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0013 for user-log deletion with retainTimeStamp:1383322252713
2013-10-31 16:10:52,798 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_-28830232 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:52,809 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17693 with signal TERM. Exit code 0
2013-10-31 16:10:52,975 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:52,975 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:52,976 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:52,976 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_-28830232 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:53,333 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_1197284086 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:53,345 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17878 with signal TERM. Exit code 0
2013-10-31 16:10:53,515 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:53,516 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:53,516 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:53,516 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_1197284086 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:53,746 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_3145602704174950073_1153 to 127.0.0.1:50942
2013-10-31 16:10:53,748 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3145602704174950073_1153 src: /127.0.0.1:34733 dest: /127.0.0.1:50942
2013-10-31 16:10:53,748 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_3145602704174950073_1153 to /127.0.0.1:50942
2013-10-31 16:10:53,751 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3145602704174950073_1153 src: /127.0.0.1:34733 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:10:53,754 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3145602704174950073_1153 size 238055
2013-10-31 16:10:53,948 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6351416155261990527_1145 file build/test/data/dfs/data/data8/current/blk_-6351416155261990527 for deletion
2013-10-31 16:10:53,948 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6351416155261990527_1145 at file build/test/data/dfs/data/data8/current/blk_-6351416155261990527
2013-10-31 16:10:54,375 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000006_0 0.0% setup
2013-10-31 16:10:54,378 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000006_0 is done.
2013-10-31 16:10:54,378 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000006_0 was -1
2013-10-31 16:10:54,379 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:10:54,746 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:54,746 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000000_0 not found in cache
2013-10-31 16:10:54,746 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000001_0 not found in cache
2013-10-31 16:10:54,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0013 for user-log deletion with retainTimeStamp:1383322254747
2013-10-31 16:10:55,010 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0013
2013-10-31 16:10:55,011 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000002_0 not found in cache
2013-10-31 16:10:55,011 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0013_m_000003_0 not found in cache
2013-10-31 16:10:55,012 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0013 for user-log deletion with retainTimeStamp:1383322255011
2013-10-31 16:10:55,137 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_299302560 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:55,146 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17594 with signal TERM. Exit code 0
2013-10-31 16:10:55,206 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0013_m_-544706238 since job job_20131031160444934_0013 is dead
2013-10-31 16:10:55,210 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17629 with signal TERM. Exit code 0
2013-10-31 16:10:55,315 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:55,316 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:55,316 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:55,317 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_299302560 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:55,375 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:55,376 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:55,376 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:55,376 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_-544706238 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:55,752 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000006_0' has completed task_20131031160444934_0014_m_000006 successfully.
2013-10-31 16:10:55,761 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000000_0' to tip task_20131031160444934_0014_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:55,762 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000000
2013-10-31 16:10:55,762 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000001_0' to tip task_20131031160444934_0014_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:10:55,763 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000001
2013-10-31 16:10:55,765 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:10:55,766 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:10:55,766 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000000_0 which needs 1 slots
2013-10-31 16:10:55,766 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000000_0 which needs 1 slots
2013-10-31 16:10:55,766 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000001_0 which needs 1 slots
2013-10-31 16:10:55,767 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0014_m_000001_0 which needs 1 slots
2013-10-31 16:10:55,803 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0014/attempt_20131031160444934_0014_m_000000_0. Attempting to reuse: jvm_20131031160444934_0014_m_-1305407431
2013-10-31 16:10:55,803 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0013_m_1014058939
2013-10-31 16:10:55,807 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17531 with signal TERM. Exit code 0
2013-10-31 16:10:55,807 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-291033684
2013-10-31 16:10:55,808 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-291033684 spawned.
2013-10-31 16:10:55,809 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000001_0/taskjvm.sh
2013-10-31 16:10:55,917 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:10:55,918 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:10:55,918 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:10:55,918 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0013_m_1014058939 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:10:55,938 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1305407431 given task: attempt_20131031160444934_0014_m_000000_0
2013-10-31 16:10:56,015 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000002_0' to tip task_20131031160444934_0014_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:56,016 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000002
2013-10-31 16:10:56,016 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000003_0' to tip task_20131031160444934_0014_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:10:56,016 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000003
2013-10-31 16:10:56,017 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:10:56,017 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:10:56,018 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000002_0 which needs 1 slots
2013-10-31 16:10:56,018 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000002_0 which needs 1 slots
2013-10-31 16:10:56,018 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000003_0 which needs 1 slots
2013-10-31 16:10:56,018 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0014_m_000003_0 which needs 1 slots
2013-10-31 16:10:56,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken dst=null perm=null
2013-10-31 16:10:56,022 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34805, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 135836
2013-10-31 16:10:56,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml dst=null perm=null
2013-10-31 16:10:56,026 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34738, bytes: 29039, op: HDFS_READ, cliID: DFSClient_1552433242, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7152624195160131338_1156, duration: 216561
2013-10-31 16:10:56,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=null
2013-10-31 16:10:56,040 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:56,041 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34739, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_362137174242859386_1154, duration: 151892
2013-10-31 16:10:56,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar dst=null perm=null
2013-10-31 16:10:56,054 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34740, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1552433242, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3145602704174950073_1153, duration: 630180
2013-10-31 16:10:56,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:56,123 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-766613114
2013-10-31 16:10:56,124 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-766613114 spawned.
2013-10-31 16:10:56,124 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-1082003416
2013-10-31 16:10:56,124 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-1082003416 spawned.
2013-10-31 16:10:56,125 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000002_0/taskjvm.sh
2013-10-31 16:10:56,125 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000003_0/taskjvm.sh
2013-10-31 16:10:56,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:56,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:56,449 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47843, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 130986
2013-10-31 16:10:56,452 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34742, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 103919
2013-10-31 16:10:56,677 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-291033684 given task: attempt_20131031160444934_0014_m_000001_0
2013-10-31 16:10:56,717 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0014_m_000004_0' to tip task_20131031160444934_0014_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:10:56,718 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0014_m_000004
2013-10-31 16:10:56,719 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:10:56,719 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000004_0 which needs 1 slots
2013-10-31 16:10:56,719 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000004_0 which needs 1 slots
2013-10-31 16:10:56,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014/jobToken dst=null perm=null
2013-10-31 16:10:56,724 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34813, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7144251647658547015_1159, duration: 137221
2013-10-31 16:10:56,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.xml dst=null perm=null
2013-10-31 16:10:56,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34815, bytes: 29039, op: HDFS_READ, cliID: DFSClient_929937689, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7152624195160131338_1156, duration: 180938
2013-10-31 16:10:56,742 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:10:56,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.jar dst=null perm=null
2013-10-31 16:10:56,757 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34816, bytes: 239915, op: HDFS_READ, cliID: DFSClient_929937689, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3145602704174950073_1153, duration: 663942
2013-10-31 16:10:56,811 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_m_-1646548683
2013-10-31 16:10:56,812 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_m_-1646548683 spawned.
2013-10-31 16:10:56,813 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_m_000004_0/taskjvm.sh
2013-10-31 16:10:57,023 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-766613114 given task: attempt_20131031160444934_0014_m_000002_0
2013-10-31 16:10:57,030 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1082003416 given task: attempt_20131031160444934_0014_m_000003_0
2013-10-31 16:10:57,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=null
2013-10-31 16:10:57,227 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34820, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_362137174242859386_1154, duration: 213805
2013-10-31 16:10:57,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:57,266 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34752, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 126454
2013-10-31 16:10:57,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:57,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:57,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=null
2013-10-31 16:10:57,544 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54861, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 138833
2013-10-31 16:10:57,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=null
2013-10-31 16:10:57,549 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54862, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_362137174242859386_1154, duration: 169405
2013-10-31 16:10:57,550 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34758, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_362137174242859386_1154, duration: 146579
2013-10-31 16:10:57,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:57,588 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34759, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 122725
2013-10-31 16:10:57,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:57,590 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34829, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 106900
2013-10-31 16:10:57,762 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1646548683 given task: attempt_20131031160444934_0014_m_000004_0
2013-10-31 16:10:57,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:57,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:57,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:57,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:57,875 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34762, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 131350
2013-10-31 16:10:57,876 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54868, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 136171
2013-10-31 16:10:58,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014/job.split dst=null perm=null
2013-10-31 16:10:58,263 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34834, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_362137174242859386_1154, duration: 413543
2013-10-31 16:10:58,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:10:58,303 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34835, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 313234
2013-10-31 16:10:58,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:58,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:10:58,601 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47869, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0014_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 132867
2013-10-31 16:10:59,006 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:10:59,008 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000000_0 is done.
2013-10-31 16:10:59,009 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000000_0 was 35
2013-10-31 16:10:59,009 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:11:00,156 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:11:00,158 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000001_0 is done.
2013-10-31 16:11:00,159 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000001_0 was 35
2013-10-31 16:11:00,159 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:00,462 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:11:00,464 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000003_0 is done.
2013-10-31 16:11:00,464 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000003_0 was 35
2013-10-31 16:11:00,464 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:11:00,464 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:11:00,466 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000002_0 is done.
2013-10-31 16:11:00,466 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000002_0 was 35
2013-10-31 16:11:00,466 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:00,766 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0014_m_000006_0
2013-10-31 16:11:00,766 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0014_m_000006_0
2013-10-31 16:11:00,767 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0014_m_000006_0 not found in cache
2013-10-31 16:11:01,182 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:11:01,185 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000004_0 is done.
2013-10-31 16:11:01,185 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000004_0 was 35
2013-10-31 16:11:01,186 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:01,772 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000000_0' has completed task_20131031160444934_0014_m_000000 successfully.
2013-10-31 16:11:01,773 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000001_0' has completed task_20131031160444934_0014_m_000001 successfully.
2013-10-31 16:11:01,774 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0014_r_000000_0' to tip task_20131031160444934_0014_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:01,776 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:11:01,777 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_r_000000_0 which needs 1 slots
2013-10-31 16:11:01,777 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_r_000000_0 which needs 1 slots
2013-10-31 16:11:01,797 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0014_r_-1113874899
2013-10-31 16:11:01,798 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0014_r_-1113874899 spawned.
2013-10-31 16:11:01,801 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0014/attempt_20131031160444934_0014_r_000000_0/taskjvm.sh
2013-10-31 16:11:01,836 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3451961400852813586_1083
2013-10-31 16:11:02,024 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000002_0' has completed task_20131031160444934_0014_m_000002 successfully.
2013-10-31 16:11:02,763 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000003_0' has completed task_20131031160444934_0014_m_000003 successfully.
2013-10-31 16:11:02,764 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000004_0' has completed task_20131031160444934_0014_m_000004 successfully.
2013-10-31 16:11:03,537 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_r_-1113874899 given task: attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:09,227 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46564, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000000_0, duration: 9467744
2013-10-31 16:11:09,244 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46564, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000001_0, duration: 9945651
2013-10-31 16:11:09,261 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58497, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000002_0, duration: 12154305
2013-10-31 16:11:09,276 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58497, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000003_0, duration: 11459409
2013-10-31 16:11:09,293 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:42700, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0014_m_000004_0, duration: 12626467
2013-10-31 16:11:10,045 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,089 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,148 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:10,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:10,390 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000. blk_-8992668016065045310_1160
2013-10-31 16:11:10,431 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8992668016065045310_1160 src: /127.0.0.1:54879 dest: /127.0.0.1:41648
2013-10-31 16:11:10,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8992668016065045310_1160 src: /127.0.0.1:47877 dest: /127.0.0.1:47311
2013-10-31 16:11:10,434 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8992668016065045310_1160 src: /127.0.0.1:34845 dest: /127.0.0.1:38271
2013-10-31 16:11:10,436 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34845, dest: /127.0.0.1:38271, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0014_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8992668016065045310_1160, duration: 1323698
2013-10-31 16:11:10,436 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8992668016065045310_1160 terminating
2013-10-31 16:11:10,436 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47877, dest: /127.0.0.1:47311, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0014_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8992668016065045310_1160, duration: 1265717
2013-10-31 16:11:10,436 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8992668016065045310_1160 terminating
2013-10-31 16:11:10,437 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54879, dest: /127.0.0.1:41648, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0014_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8992668016065045310_1160, duration: 1790655
2013-10-31 16:11:10,437 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8992668016065045310_1160 terminating
2013-10-31 16:11:10,439 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8992668016065045310_1160 size 240
2013-10-31 16:11:10,440 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:10,440 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:10,440 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8992668016065045310_1160 size 240
2013-10-31 16:11:10,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8992668016065045310_1160 size 240
2013-10-31 16:11:10,477 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0014_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:10,477 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:11:10,786 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0014_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:11:10,787 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:11,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0 dst=null perm=null
2013-10-31 16:11:11,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:12,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:12,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary/_attempt_20131031160444934_0014_r_000000_0 dst=null perm=null
2013-10-31 16:11:13,095 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 1.0% reduce > reduce
2013-10-31 16:11:13,097 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_r_000000_0 1.0% reduce > reduce
2013-10-31 16:11:13,098 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_r_000000_0 is done.
2013-10-31 16:11:13,098 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_r_000000_0 was -1
2013-10-31 16:11:13,098 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:13,791 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_r_000000_0' has completed task_20131031160444934_0014_r_000000 successfully.
2013-10-31 16:11:13,874 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0014_m_000005_0' to tip task_20131031160444934_0014_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:13,877 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0014_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:11:13,877 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0014_m_000005_0 which needs 1 slots
2013-10-31 16:11:13,877 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0014_m_000005_0 which needs 1 slots
2013-10-31 16:11:14,051 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0014/attempt_20131031160444934_0014_m_000005_0. Attempting to reuse: jvm_20131031160444934_0014_m_-1305407431
2013-10-31 16:11:14,555 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0014_m_-1305407431 given task: attempt_20131031160444934_0014_m_000005_0
2013-10-31 16:11:14,660 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000005_0 0.0%
2013-10-31 16:11:14,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_temporary dst=null perm=null
2013-10-31 16:11:14,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:14,678 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_SUCCESS from client DFSClient_attempt_20131031160444934_0014_m_000005_0
2013-10-31 16:11:14,678 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0014_m_000005_0
2013-10-31 16:11:14,684 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:14,685 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:14,685 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,685 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3145602704174950073 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,685 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:14,685 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:14,685 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,685 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_362137174242859386 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,686 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7737511616191737526 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,686 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7737511616191737526 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:14,686 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7737511616191737526 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,686 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7152624195160131338 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:14,686 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7152624195160131338 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:14,686 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7152624195160131338 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:14,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0014 dst=null perm=null
2013-10-31 16:11:15,229 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_7152624195160131338_1156 blk_3145602704174950073_1153 blk_362137174242859386_1154 blk_-7737511616191737526_1155
2013-10-31 16:11:15,229 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_7152624195160131338_1156 blk_3145602704174950073_1153 blk_362137174242859386_1154 blk_-7737511616191737526_1155
2013-10-31 16:11:17,634 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0014_m_000005_0 0.0% cleanup
2013-10-31 16:11:17,636 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0014_m_000005_0 is done.
2013-10-31 16:11:17,636 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0014_m_000005_0 was -1
2013-10-31 16:11:17,636 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:17,754 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7737511616191737526_1155 file build/test/data/dfs/data/data2/current/blk_-7737511616191737526 for deletion
2013-10-31 16:11:17,754 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data1/current/blk_362137174242859386 for deletion
2013-10-31 16:11:17,754 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7737511616191737526_1155 at file build/test/data/dfs/data/data2/current/blk_-7737511616191737526
2013-10-31 16:11:17,754 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data2/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:17,754 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data1/current/blk_362137174242859386
2013-10-31 16:11:17,755 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7152624195160131338_1156 file build/test/data/dfs/data/data1/current/blk_7152624195160131338 for deletion
2013-10-31 16:11:17,755 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data2/current/blk_3145602704174950073
2013-10-31 16:11:17,755 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7152624195160131338_1156 at file build/test/data/dfs/data/data1/current/blk_7152624195160131338
2013-10-31 16:11:17,956 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7737511616191737526_1155 file build/test/data/dfs/data/data8/current/blk_-7737511616191737526 for deletion
2013-10-31 16:11:17,956 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data7/current/blk_362137174242859386 for deletion
2013-10-31 16:11:17,956 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7737511616191737526_1155 at file build/test/data/dfs/data/data8/current/blk_-7737511616191737526
2013-10-31 16:11:17,957 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data7/current/blk_362137174242859386
2013-10-31 16:11:17,957 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data8/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:17,957 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7152624195160131338_1156 file build/test/data/dfs/data/data7/current/blk_7152624195160131338 for deletion
2013-10-31 16:11:17,958 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data8/current/blk_3145602704174950073
2013-10-31 16:11:17,958 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7152624195160131338_1156 at file build/test/data/dfs/data/data7/current/blk_7152624195160131338
2013-10-31 16:11:18,230 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_3145602704174950073_1153 blk_362137174242859386_1154 blk_-7737511616191737526_1155
2013-10-31 16:11:18,230 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_7152624195160131338_1156 blk_3145602704174950073_1153 blk_362137174242859386_1154
2013-10-31 16:11:18,354 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data3/current/blk_362137174242859386 for deletion
2013-10-31 16:11:18,355 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data4/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:18,355 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data3/current/blk_362137174242859386
2013-10-31 16:11:18,355 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7152624195160131338_1156 file build/test/data/dfs/data/data4/current/blk_7152624195160131338 for deletion
2013-10-31 16:11:18,355 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data4/current/blk_3145602704174950073
2013-10-31 16:11:18,356 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7152624195160131338_1156 at file build/test/data/dfs/data/data4/current/blk_7152624195160131338
2013-10-31 16:11:18,877 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:18,877 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0014_r_000000_0
2013-10-31 16:11:18,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7737511616191737526_1155 file build/test/data/dfs/data/data6/current/blk_-7737511616191737526 for deletion
2013-10-31 16:11:18,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_362137174242859386_1154 file build/test/data/dfs/data/data5/current/blk_362137174242859386 for deletion
2013-10-31 16:11:18,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7737511616191737526_1155 at file build/test/data/dfs/data/data6/current/blk_-7737511616191737526
2013-10-31 16:11:18,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3145602704174950073_1153 file build/test/data/dfs/data/data6/current/blk_3145602704174950073 for deletion
2013-10-31 16:11:18,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_362137174242859386_1154 at file build/test/data/dfs/data/data5/current/blk_362137174242859386
2013-10-31 16:11:18,968 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3145602704174950073_1153 at file build/test/data/dfs/data/data6/current/blk_3145602704174950073
2013-10-31 16:11:19,884 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0014_m_000005_0' has completed task_20131031160444934_0014_m_000005 successfully.
2013-10-31 16:11:19,885 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0014 has completed successfully.
2013-10-31 16:11:19,885 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0014,submitTime=1383235848494,launchTime=1383235849126,firstMapTaskLaunchTime=1383235855760,firstReduceTaskLaunchTime=1383235861774,firstJobSetupTaskLaunchTime=1383235849739,firstJobCleanupTaskLaunchTime=1383235873874,finishTime=1383235879885,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=28,reduceSlotsSeconds=11,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[EF9B8E00CB3E43349A0B2FF055BDD740/7920D98E474F40E192B1E8DF84897267] lower*upper*joined/(2/2)
2013-10-31 16:11:19,892 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1. blk_-4576546115426846666_1161
2013-10-31 16:11:19,894 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4576546115426846666_1161 src: /127.0.0.1:47881 dest: /127.0.0.1:47311
2013-10-31 16:11:19,897 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4576546115426846666_1161 src: /127.0.0.1:34781 dest: /127.0.0.1:50942
2013-10-31 16:11:19,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4576546115426846666_1161 src: /127.0.0.1:54887 dest: /127.0.0.1:41648
2013-10-31 16:11:19,904 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54887, dest: /127.0.0.1:41648, bytes: 31976, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4576546115426846666_1161, duration: 101651
2013-10-31 16:11:19,905 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4576546115426846666_1161 terminating
2013-10-31 16:11:19,905 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34781, dest: /127.0.0.1:50942, bytes: 31976, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4576546115426846666_1161, duration: 3803760
2013-10-31 16:11:19,906 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4576546115426846666_1161 terminating
2013-10-31 16:11:19,906 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47881, dest: /127.0.0.1:47311, bytes: 31976, op: HDFS_WRITE, cliID: DFSClient_1152728397, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4576546115426846666_1161, duration: 4741960
2013-10-31 16:11:19,907 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4576546115426846666_1161 terminating
2013-10-31 16:11:19,907 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4576546115426846666_1161 size 31976
2013-10-31 16:11:19,910 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1 from client DFSClient_1152728397
2013-10-31 16:11:19,911 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/_logs/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1 is closed by DFSClient_1152728397
2013-10-31 16:11:19,911 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4576546115426846666_1161 size 31976
2013-10-31 16:11:19,911 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4576546115426846666_1161 size 31976
2013-10-31 16:11:19,916 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0014_1383235848494_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2F7920D98E474F40E1 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:19,917 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000000_0'
2013-10-31 16:11:19,918 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7144251647658547015 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:19,918 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000001_0'
2013-10-31 16:11:19,918 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7144251647658547015 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:19,918 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000005_0'
2013-10-31 16:11:19,919 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7144251647658547015 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:19,919 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000006_0'
2013-10-31 16:11:19,919 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_r_000000_0'
2013-10-31 16:11:19,922 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0014_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:19,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0014 dst=null perm=null
2013-10-31 16:11:19,924 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] starting step: (1/2) ...splatform/joingroupbyjoin
2013-10-31 16:11:19,930 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:11:19,930 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:11:19,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:19,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:11:19,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:19,949 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar. blk_7182447276496863409_1162
2013-10-31 16:11:19,950 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:34784 dest: /127.0.0.1:50942
2013-10-31 16:11:19,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:47887 dest: /127.0.0.1:47311
2013-10-31 16:11:19,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:54891 dest: /127.0.0.1:41648
2013-10-31 16:11:19,961 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54891, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7182447276496863409_1162, duration: 5929978
2013-10-31 16:11:19,961 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7182447276496863409_1162 terminating
2013-10-31 16:11:19,961 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:19,962 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47887, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7182447276496863409_1162, duration: 7560530
2013-10-31 16:11:19,962 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7182447276496863409_1162 terminating
2013-10-31 16:11:19,963 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34784, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7182447276496863409_1162, duration: 8051684
2013-10-31 16:11:19,963 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7182447276496863409_1162 terminating
2013-10-31 16:11:19,963 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:19,965 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar from client DFSClient_1457307213
2013-10-31 16:11:19,965 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar is closed by DFSClient_1457307213
2013-10-31 16:11:19,966 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:19,970 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar. New replication is 10
2013-10-31 16:11:19,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar dst=null perm=null
2013-10-31 16:11:20,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,385 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:11:20,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84 dst=null perm=null
2013-10-31 16:11:20,389 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:20,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000 dst=null perm=null
2013-10-31 16:11:20,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,407 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split. New replication is 10
2013-10-31 16:11:20,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split dst=null perm=null
2013-10-31 16:11:20,417 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split. blk_5457425651477839543_1163
2013-10-31 16:11:20,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:34787 dest: /127.0.0.1:50942
2013-10-31 16:11:20,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:47890 dest: /127.0.0.1:47311
2013-10-31 16:11:20,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:34858 dest: /127.0.0.1:38271
2013-10-31 16:11:20,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5457425651477839543_1163 src: /127.0.0.1:54895 dest: /127.0.0.1:41648
2013-10-31 16:11:20,424 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54895, dest: /127.0.0.1:41648, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5457425651477839543_1163, duration: 113902
2013-10-31 16:11:20,424 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,424 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34858, dest: /127.0.0.1:38271, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5457425651477839543_1163, duration: 466250
2013-10-31 16:11:20,424 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,425 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,425 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47890, dest: /127.0.0.1:47311, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5457425651477839543_1163, duration: 857923
2013-10-31 16:11:20,425 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,425 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,426 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34787, dest: /127.0.0.1:50942, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5457425651477839543_1163, duration: 1804688
2013-10-31 16:11:20,426 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5457425651477839543_1163 terminating
2013-10-31 16:11:20,430 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5457425651477839543_1163 size 358
2013-10-31 16:11:20,430 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split from client DFSClient_1457307213
2013-10-31 16:11:20,430 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split is closed by DFSClient_1457307213
2013-10-31 16:11:20,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,451 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo. blk_-2024600585106326716_1164
2013-10-31 16:11:20,452 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2024600585106326716_1164 src: /127.0.0.1:54896 dest: /127.0.0.1:41648
2013-10-31 16:11:20,454 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2024600585106326716_1164 src: /127.0.0.1:34792 dest: /127.0.0.1:50942
2013-10-31 16:11:20,455 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2024600585106326716_1164 src: /127.0.0.1:34862 dest: /127.0.0.1:38271
2013-10-31 16:11:20,457 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34862, dest: /127.0.0.1:38271, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2024600585106326716_1164, duration: 70958
2013-10-31 16:11:20,458 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2024600585106326716_1164 terminating
2013-10-31 16:11:20,458 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34792, dest: /127.0.0.1:50942, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2024600585106326716_1164, duration: 905546
2013-10-31 16:11:20,459 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2024600585106326716_1164 terminating
2013-10-31 16:11:20,459 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2024600585106326716_1164 size 44
2013-10-31 16:11:20,459 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54896, dest: /127.0.0.1:41648, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2024600585106326716_1164, duration: 2049344
2013-10-31 16:11:20,460 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2024600585106326716_1164 size 44
2013-10-31 16:11:20,460 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2024600585106326716_1164 terminating
2013-10-31 16:11:20,462 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2024600585106326716_1164 size 44
2013-10-31 16:11:20,462 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:11:20,463 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:11:20,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,494 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml. blk_2522765479875883258_1165
2013-10-31 16:11:20,495 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2522765479875883258_1165 src: /127.0.0.1:47896 dest: /127.0.0.1:47311
2013-10-31 16:11:20,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2522765479875883258_1165 src: /127.0.0.1:34795 dest: /127.0.0.1:50942
2013-10-31 16:11:20,498 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2522765479875883258_1165 src: /127.0.0.1:34865 dest: /127.0.0.1:38271
2013-10-31 16:11:20,501 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34865, dest: /127.0.0.1:38271, bytes: 28698, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2522765479875883258_1165, duration: 1384267
2013-10-31 16:11:20,502 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2522765479875883258_1165 terminating
2013-10-31 16:11:20,502 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34795, dest: /127.0.0.1:50942, bytes: 28698, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2522765479875883258_1165, duration: 1337163
2013-10-31 16:11:20,503 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2522765479875883258_1165 terminating
2013-10-31 16:11:20,503 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47896, dest: /127.0.0.1:47311, bytes: 28698, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2522765479875883258_1165, duration: 2429278
2013-10-31 16:11:20,504 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2522765479875883258_1165 terminating
2013-10-31 16:11:20,504 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2522765479875883258_1165 size 28698
2013-10-31 16:11:20,505 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml from client DFSClient_1457307213
2013-10-31 16:11:20,506 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml is closed by DFSClient_1457307213
2013-10-31 16:11:20,506 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2522765479875883258_1165 size 28698
2013-10-31 16:11:20,507 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2522765479875883258_1165 size 28698
2013-10-31 16:11:20,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml dst=null perm=null
2013-10-31 16:11:20,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34798, bytes: 28926, op: HDFS_READ, cliID: DFSClient_37059141, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2522765479875883258_1165, duration: 388612
2013-10-31 16:11:20,547 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0015: nMaps=1 nReduces=0 max=-1
2013-10-31 16:11:20,547 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0015 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:11:20,547 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0015
2013-10-31 16:11:20,548 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0015 RESULT=SUCCESS
2013-10-31 16:11:20,548 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0015
2013-10-31 16:11:20,550 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper*joined] submitted hadoop job: job_20131031160444934_0015
2013-10-31 16:11:20,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,585 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml. blk_-9178176872107315078_1167
2013-10-31 16:11:20,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9178176872107315078_1167 src: /127.0.0.1:34868 dest: /127.0.0.1:38271
2013-10-31 16:11:20,589 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9178176872107315078_1167 src: /127.0.0.1:54905 dest: /127.0.0.1:41648
2013-10-31 16:11:20,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9178176872107315078_1167 src: /127.0.0.1:34801 dest: /127.0.0.1:50942
2013-10-31 16:11:20,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34801, dest: /127.0.0.1:50942, bytes: 28763, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9178176872107315078_1167, duration: 622508
2013-10-31 16:11:20,597 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9178176872107315078_1167 terminating
2013-10-31 16:11:20,597 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54905, dest: /127.0.0.1:41648, bytes: 28763, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9178176872107315078_1167, duration: 1396901
2013-10-31 16:11:20,598 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9178176872107315078_1167 terminating
2013-10-31 16:11:20,598 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34868, dest: /127.0.0.1:38271, bytes: 28763, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9178176872107315078_1167, duration: 2853736
2013-10-31 16:11:20,599 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9178176872107315078_1167 size 28763
2013-10-31 16:11:20,599 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9178176872107315078_1167 terminating
2013-10-31 16:11:20,601 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9178176872107315078_1167 size 28763
2013-10-31 16:11:20,602 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml from client DFSClient_37059141
2013-10-31 16:11:20,602 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_conf.xml is closed by DFSClient_37059141
2013-10-31 16:11:20,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9178176872107315078_1167 size 28763
2013-10-31 16:11:20,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:20,618 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken. blk_4981770940444099633_1168
2013-10-31 16:11:20,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4981770940444099633_1168 src: /127.0.0.1:54907 dest: /127.0.0.1:41648
2013-10-31 16:11:20,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4981770940444099633_1168 src: /127.0.0.1:34872 dest: /127.0.0.1:38271
2013-10-31 16:11:20,622 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4981770940444099633_1168 src: /127.0.0.1:47906 dest: /127.0.0.1:47311
2013-10-31 16:11:20,625 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47906, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4981770940444099633_1168, duration: 62550
2013-10-31 16:11:20,626 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4981770940444099633_1168 terminating
2013-10-31 16:11:20,626 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34872, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4981770940444099633_1168, duration: 827167
2013-10-31 16:11:20,626 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4981770940444099633_1168 terminating
2013-10-31 16:11:20,627 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4981770940444099633_1168 size 116
2013-10-31 16:11:20,627 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54907, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4981770940444099633_1168, duration: 1743774
2013-10-31 16:11:20,628 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4981770940444099633_1168 size 116
2013-10-31 16:11:20,628 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4981770940444099633_1168 terminating
2013-10-31 16:11:20,631 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4981770940444099633_1168 size 116
2013-10-31 16:11:20,631 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken from client DFSClient_1457307213
2013-10-31 16:11:20,632 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken is closed by DFSClient_1457307213
2013-10-31 16:11:20,638 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken
2013-10-31 16:11:20,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.splitmetainfo dst=null perm=null
2013-10-31 16:11:20,642 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34805, bytes: 48, op: HDFS_READ, cliID: DFSClient_37059141, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2024600585106326716_1164, duration: 278413
2013-10-31 16:11:20,643 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0015 = 240. Number of splits = 1
2013-10-31 16:11:20,643 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:20,643 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:20,643 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:20,644 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0015 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:11:20,644 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0015 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 16:11:20,784 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0015_m_000002_0' to tip task_20131031160444934_0015_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:20,789 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000002_0'
2013-10-31 16:11:20,790 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000003_0'
2013-10-31 16:11:20,793 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0015_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:11:20,794 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:20,794 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0015_m_000002_0 which needs 1 slots
2013-10-31 16:11:20,794 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0014 being deleted.
2013-10-31 16:11:20,794 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0014_m_000004_0'
2013-10-31 16:11:20,794 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0015_m_000002_0 which needs 1 slots
2013-10-31 16:11:20,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015/jobToken dst=null perm=null
2013-10-31 16:11:20,803 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34875, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4981770940444099633_1168, duration: 298341
2013-10-31 16:11:20,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.xml dst=null perm=null
2013-10-31 16:11:20,812 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34808, bytes: 28926, op: HDFS_READ, cliID: DFSClient_-262427717, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2522765479875883258_1165, duration: 391027
2013-10-31 16:11:20,843 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:20,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.jar dst=null perm=null
2013-10-31 16:11:20,881 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54914, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-262427717, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7182447276496863409_1162, duration: 1314861
2013-10-31 16:11:20,965 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0014_m_-1082003416
2013-10-31 16:11:20,972 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18266 with signal TERM. Exit code 0
2013-10-31 16:11:20,972 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0015_m_1034060197
2013-10-31 16:11:20,973 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0015_m_1034060197 spawned.
2013-10-31 16:11:20,974 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0015/attempt_20131031160444934_0015_m_000002_0/taskjvm.sh
2013-10-31 16:11:21,077 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:21,078 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:21,078 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:21,078 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-1082003416 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:21,231 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_7182447276496863409_1162 to datanode(s) 127.0.0.1:38271
2013-10-31 16:11:21,232 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_7144251647658547015_1159
2013-10-31 16:11:21,232 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_7144251647658547015_1159
2013-10-31 16:11:21,968 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7144251647658547015_1159 file build/test/data/dfs/data/data6/current/blk_7144251647658547015 for deletion
2013-10-31 16:11:21,968 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7144251647658547015_1159 at file build/test/data/dfs/data/data6/current/blk_7144251647658547015
2013-10-31 16:11:22,901 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0015_m_1034060197 given task: attempt_20131031160444934_0015_m_000002_0
2013-10-31 16:11:23,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:23,958 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_7182447276496863409_1162 to 127.0.0.1:38271
2013-10-31 16:11:23,958 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7144251647658547015_1159 file build/test/data/dfs/data/data7/current/blk_7144251647658547015 for deletion
2013-10-31 16:11:23,959 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7144251647658547015_1159 at file build/test/data/dfs/data/data7/current/blk_7144251647658547015
2013-10-31 16:11:23,960 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7182447276496863409_1162 src: /127.0.0.1:34881 dest: /127.0.0.1:38271
2013-10-31 16:11:23,960 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_7182447276496863409_1162 to /127.0.0.1:38271
2013-10-31 16:11:23,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7182447276496863409_1162 src: /127.0.0.1:34881 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:11:23,967 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7182447276496863409_1162 size 238055
2013-10-31 16:11:24,233 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_7144251647658547015_1159
2013-10-31 16:11:24,920 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:24,921 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0014_m_000005_0 not found in cache
2013-10-31 16:11:24,922 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0014 for user-log deletion with retainTimeStamp:1383322284921
2013-10-31 16:11:25,635 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_r_-1113874899 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:25,646 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18505 with signal TERM. Exit code 0
2013-10-31 16:11:25,676 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-1305407431 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:25,682 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18054 with signal TERM. Exit code 0
2013-10-31 16:11:25,794 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:25,795 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0014 for user-log deletion with retainTimeStamp:1383322285795
2013-10-31 16:11:25,822 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:25,822 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:25,822 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:25,822 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_r_-1113874899 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:25,831 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0014
2013-10-31 16:11:25,831 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0014 for user-log deletion with retainTimeStamp:1383322285831
2013-10-31 16:11:25,850 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:25,850 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:25,850 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:25,851 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-1305407431 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:11:26,240 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-291033684 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:26,250 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18195 with signal TERM. Exit code 0
2013-10-31 16:11:26,347 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000002_0 0.0% setup
2013-10-31 16:11:26,349 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0015_m_000002_0 is done.
2013-10-31 16:11:26,349 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0015_m_000002_0 was -1
2013-10-31 16:11:26,349 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:26,462 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:26,462 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:26,462 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:26,462 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-291033684 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:26,546 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-766613114 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:26,556 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18262 with signal TERM. Exit code 0
2013-10-31 16:11:26,757 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7144251647658547015_1159 file build/test/data/dfs/data/data2/current/blk_7144251647658547015 for deletion
2013-10-31 16:11:26,757 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7144251647658547015_1159 at file build/test/data/dfs/data/data2/current/blk_7144251647658547015
2013-10-31 16:11:26,797 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:26,797 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:26,797 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:26,797 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-766613114 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:26,800 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0015_m_000002_0' has completed task_20131031160444934_0015_m_000002 successfully.
2013-10-31 16:11:26,802 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0015_m_000000_0' to tip task_20131031160444934_0015_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:26,803 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0015_m_000000
2013-10-31 16:11:26,805 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0015_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:11:26,805 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0015_m_000000_0 which needs 1 slots
2013-10-31 16:11:26,805 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0015_m_000000_0 which needs 1 slots
2013-10-31 16:11:26,825 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0015_m_1172956060
2013-10-31 16:11:26,825 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0015_m_1172956060 spawned.
2013-10-31 16:11:26,826 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0015/attempt_20131031160444934_0015_m_000000_0/taskjvm.sh
2013-10-31 16:11:27,274 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0014_m_-1646548683 since job job_20131031160444934_0014 is dead
2013-10-31 16:11:27,282 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18360 with signal TERM. Exit code 0
2013-10-31 16:11:27,500 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:27,500 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:27,500 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:27,500 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0014_m_-1646548683 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:27,987 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0015_m_1172956060 given task: attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:28,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015/job.split dst=null perm=null
2013-10-31 16:11:28,517 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34815, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5457425651477839543_1163, duration: 267206
2013-10-31 16:11:28,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000 dst=null perm=null
2013-10-31 16:11:28,554 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34885, bytes: 244, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8992668016065045310_1160, duration: 251325
2013-10-31 16:11:28,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:28,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:28,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 16:11:28,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 16:11:28,817 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34817, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5586763943079904199_1152, duration: 274952
2013-10-31 16:11:28,830 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000. blk_-8045400518665573082_1169
2013-10-31 16:11:28,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8045400518665573082_1169 src: /127.0.0.1:54923 dest: /127.0.0.1:41648
2013-10-31 16:11:28,868 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8045400518665573082_1169 src: /127.0.0.1:47921 dest: /127.0.0.1:47311
2013-10-31 16:11:28,869 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8045400518665573082_1169 src: /127.0.0.1:34820 dest: /127.0.0.1:50942
2013-10-31 16:11:28,871 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34820, dest: /127.0.0.1:50942, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8045400518665573082_1169, duration: 937199
2013-10-31 16:11:28,871 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8045400518665573082_1169 terminating
2013-10-31 16:11:28,871 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47921, dest: /127.0.0.1:47311, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8045400518665573082_1169, duration: 1293894
2013-10-31 16:11:28,871 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8045400518665573082_1169 terminating
2013-10-31 16:11:28,872 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54923, dest: /127.0.0.1:41648, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0015_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8045400518665573082_1169, duration: 1687003
2013-10-31 16:11:28,872 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8045400518665573082_1169 terminating
2013-10-31 16:11:28,873 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8045400518665573082_1169 size 70
2013-10-31 16:11:28,873 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8045400518665573082_1169 size 70
2013-10-31 16:11:28,875 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8045400518665573082_1169 size 70
2013-10-31 16:11:29,273 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:29,274 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:29,342 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0015_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:29,342 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000000_0 0.0%
2013-10-31 16:11:29,809 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0015_m_000000_0
2013-10-31 16:11:30,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0 dst=null perm=null
2013-10-31 16:11:30,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:30,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:30,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary/_attempt_20131031160444934_0015_m_000000_0 dst=null perm=null
2013-10-31 16:11:31,446 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000000_0 1.0% hdfs://localhost:43856/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84/part-00000:0+240
2013-10-31 16:11:31,448 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0015_m_000000_0 is done.
2013-10-31 16:11:31,448 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0015_m_000000_0 was -1
2013-10-31 16:11:31,449 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:31,805 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0015_m_000002_0
2013-10-31 16:11:31,805 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0015_m_000002_0
2013-10-31 16:11:31,806 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0015_m_000002_0 not found in cache
2013-10-31 16:11:32,812 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0015_m_000000_0' has completed task_20131031160444934_0015_m_000000 successfully.
2013-10-31 16:11:32,816 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0015_m_000001_0' to tip task_20131031160444934_0015_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:32,818 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0015_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:11:32,819 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0015_m_000001_0 which needs 1 slots
2013-10-31 16:11:32,819 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0015_m_000001_0 which needs 1 slots
2013-10-31 16:11:32,857 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0015/attempt_20131031160444934_0015_m_000001_0. Attempting to reuse: jvm_20131031160444934_0015_m_1172956060
2013-10-31 16:11:33,006 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0015_m_1172956060 given task: attempt_20131031160444934_0015_m_000001_0
2013-10-31 16:11:33,134 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000001_0 0.0%
2013-10-31 16:11:33,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary dst=null perm=null
2013-10-31 16:11:33,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:33,148 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS from client DFSClient_attempt_20131031160444934_0015_m_000001_0
2013-10-31 16:11:33,148 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0015_m_000001_0
2013-10-31 16:11:33,154 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:33,154 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7182447276496863409 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5457425651477839543 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2024600585106326716 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2024600585106326716 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2024600585106326716 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2522765479875883258 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:33,155 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2522765479875883258 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:33,156 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2522765479875883258 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:33,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0015 dst=null perm=null
2013-10-31 16:11:33,234 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-2024600585106326716_1164 blk_2522765479875883258_1165 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:33,234 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_2522765479875883258_1165 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:33,359 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2522765479875883258_1165 file build/test/data/dfs/data/data4/current/blk_2522765479875883258 for deletion
2013-10-31 16:11:33,359 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data3/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:33,359 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2522765479875883258_1165 at file build/test/data/dfs/data/data4/current/blk_2522765479875883258
2013-10-31 16:11:33,360 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data4/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:33,360 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data3/current/blk_5457425651477839543
2013-10-31 16:11:33,360 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data4/current/blk_7182447276496863409
2013-10-31 16:11:35,760 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2024600585106326716_1164 file build/test/data/dfs/data/data1/current/blk_-2024600585106326716 for deletion
2013-10-31 16:11:35,760 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2522765479875883258_1165 file build/test/data/dfs/data/data2/current/blk_2522765479875883258 for deletion
2013-10-31 16:11:35,760 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2024600585106326716_1164 at file build/test/data/dfs/data/data1/current/blk_-2024600585106326716
2013-10-31 16:11:35,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data2/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:35,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2522765479875883258_1165 at file build/test/data/dfs/data/data2/current/blk_2522765479875883258
2013-10-31 16:11:35,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data1/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:35,761 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data2/current/blk_5457425651477839543
2013-10-31 16:11:35,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data1/current/blk_7182447276496863409
2013-10-31 16:11:36,108 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0015_m_000001_0 0.0% cleanup
2013-10-31 16:11:36,110 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0015_m_000001_0 is done.
2013-10-31 16:11:36,110 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0015_m_000001_0 was -1
2013-10-31 16:11:36,111 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:36,235 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-2024600585106326716_1164 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:36,235 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-2024600585106326716_1164 blk_2522765479875883258_1165 blk_5457425651477839543_1163 blk_7182447276496863409_1162
2013-10-31 16:11:36,973 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2024600585106326716_1164 file build/test/data/dfs/data/data5/current/blk_-2024600585106326716 for deletion
2013-10-31 16:11:36,973 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data6/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:36,973 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2024600585106326716_1164 at file build/test/data/dfs/data/data5/current/blk_-2024600585106326716
2013-10-31 16:11:36,973 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data5/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:36,973 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data6/current/blk_5457425651477839543
2013-10-31 16:11:36,974 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data5/current/blk_7182447276496863409
2013-10-31 16:11:38,825 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0015_m_000001_0' has completed task_20131031160444934_0015_m_000001 successfully.
2013-10-31 16:11:38,843 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0015 has completed successfully.
2013-10-31 16:11:38,844 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0015,submitTime=1383235880517,launchTime=1383235880644,firstMapTaskLaunchTime=1383235886802,firstJobSetupTaskLaunchTime=1383235880784,firstJobCleanupTaskLaunchTime=1383235892816,finishTime=1383235898843,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[EF9B8E00CB3E43349A0B2FF055BDD740/EF9B40A1CFD644CD9B429BCBF6B0FC8F] lower*upper*joined/(1/2) ...splatform/joingroupbyjoin
2013-10-31 16:11:38,890 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD. blk_-7948836075426741882_1170
2013-10-31 16:11:38,892 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7948836075426741882_1170 src: /127.0.0.1:34896 dest: /127.0.0.1:38271
2013-10-31 16:11:38,894 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7948836075426741882_1170 src: /127.0.0.1:54933 dest: /127.0.0.1:41648
2013-10-31 16:11:38,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7948836075426741882_1170 src: /127.0.0.1:47931 dest: /127.0.0.1:47311
2013-10-31 16:11:38,906 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47931, dest: /127.0.0.1:47311, bytes: 11338, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7948836075426741882_1170, duration: 4612425
2013-10-31 16:11:38,906 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7948836075426741882_1170 terminating
2013-10-31 16:11:38,907 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54933, dest: /127.0.0.1:41648, bytes: 11338, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7948836075426741882_1170, duration: 4495874
2013-10-31 16:11:38,907 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7948836075426741882_1170 terminating
2013-10-31 16:11:38,908 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34896, dest: /127.0.0.1:38271, bytes: 11338, op: HDFS_WRITE, cliID: DFSClient_37059141, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7948836075426741882_1170, duration: 7426770
2013-10-31 16:11:38,908 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7948836075426741882_1170 terminating
2013-10-31 16:11:38,908 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7948836075426741882_1170 size 11338
2013-10-31 16:11:38,911 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD from client DFSClient_37059141
2013-10-31 16:11:38,912 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_logs/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD is closed by DFSClient_37059141
2013-10-31 16:11:38,912 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7948836075426741882_1170 size 11338
2013-10-31 16:11:38,913 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7948836075426741882_1170 size 11338
2013-10-31 16:11:38,920 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0015_1383235880517_hadoop_%5BEF9B8E00CB3E43349A0B2FF055BDD740%2FEF9B40A1CFD644CD to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:38,921 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0015_m_000000_0'
2013-10-31 16:11:38,921 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0015_m_000001_0'
2013-10-31 16:11:38,921 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0015_m_000002_0'
2013-10-31 16:11:38,923 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4981770940444099633 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,923 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4981770940444099633 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:38,923 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4981770940444099633 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,925 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0015_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:11:38,928 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4576546115426846666 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:38,929 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4576546115426846666 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,929 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4576546115426846666 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,929 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8751337026572452485 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0015 dst=null perm=null
2013-10-31 16:11:38,929 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8751337026572452485 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:38,930 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8751337026572452485 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,930 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8992668016065045310 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:38,930 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8992668016065045310 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:38,931 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8992668016065045310 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:38,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/9301245436_lower_upper_C5217703071248EEABBFCB8F53543A84 dst=null perm=null
2013-10-31 16:11:38,938 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/_temporary
2013-10-31 16:11:38,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2013-10-31 16:11:38,958 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:38,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2013-10-31 16:11:38,959 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:38,959 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0015 being deleted.
2013-10-31 16:11:38,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2013-10-31 16:11:38,961 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54936, bytes: 74, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8045400518665573082_1169, duration: 290820
2013-10-31 16:11:38,962 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2024600585106326716_1164 file build/test/data/dfs/data/data8/current/blk_-2024600585106326716 for deletion
2013-10-31 16:11:38,962 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2522765479875883258_1165 file build/test/data/dfs/data/data7/current/blk_2522765479875883258 for deletion
2013-10-31 16:11:38,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5457425651477839543_1163 file build/test/data/dfs/data/data7/current/blk_5457425651477839543 for deletion
2013-10-31 16:11:38,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7182447276496863409_1162 file build/test/data/dfs/data/data8/current/blk_7182447276496863409 for deletion
2013-10-31 16:11:38,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2024600585106326716_1164 at file build/test/data/dfs/data/data8/current/blk_-2024600585106326716
2013-10-31 16:11:38,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2522765479875883258_1165 at file build/test/data/dfs/data/data7/current/blk_2522765479875883258
2013-10-31 16:11:38,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7182447276496863409_1162 at file build/test/data/dfs/data/data8/current/blk_7182447276496863409
2013-10-31 16:11:38,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5457425651477839543_1163 at file build/test/data/dfs/data/data7/current/blk_5457425651477839543
2013-10-31 16:11:38,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2013-10-31 16:11:38,969 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:38,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2013-10-31 16:11:38,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2013-10-31 16:11:38,973 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34832, bytes: 74, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8045400518665573082_1169, duration: 274564
2013-10-31 16:11:38,973 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joingroupbyjoin
2013-10-31 16:11:38,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2013-10-31 16:11:38,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2013-10-31 16:11:38,979 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47935, bytes: 74, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8045400518665573082_1169, duration: 175524
2013-10-31 16:11:38,991 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:11:38,991 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:11:39,003 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] starting
2013-10-31 16:11:39,003 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:11:39,003 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:11:39,004 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross"]
2013-10-31 16:11:39,004 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] parallel execution is enabled: true
2013-10-31 16:11:39,005 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] starting jobs: 1
2013-10-31 16:11:39,005 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] allocating threads: 1
2013-10-31 16:11:39,006 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] starting step: (1/1) ...ieldedpipesplatform/cross
2013-10-31 16:11:39,010 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:11:39,010 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:11:39,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:39,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:11:39,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,032 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar. blk_-8699900213099915514_1171
2013-10-31 16:11:39,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:34834 dest: /127.0.0.1:50942
2013-10-31 16:11:39,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:47937 dest: /127.0.0.1:47311
2013-10-31 16:11:39,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:54941 dest: /127.0.0.1:41648
2013-10-31 16:11:39,044 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54941, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8699900213099915514_1171, duration: 3812164
2013-10-31 16:11:39,044 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8699900213099915514_1171 terminating
2013-10-31 16:11:39,045 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47937, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8699900213099915514_1171, duration: 4963423
2013-10-31 16:11:39,045 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,045 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8699900213099915514_1171 terminating
2013-10-31 16:11:39,046 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34834, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8699900213099915514_1171, duration: 5609811
2013-10-31 16:11:39,046 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8699900213099915514_1171 terminating
2013-10-31 16:11:39,049 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,049 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar from client DFSClient_1457307213
2013-10-31 16:11:39,050 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar is closed by DFSClient_1457307213
2013-10-31 16:11:39,050 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,055 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar. New replication is 10
2013-10-31 16:11:39,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar dst=null perm=null
2013-10-31 16:11:39,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,065 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:11:39,070 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:11:39,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:11:39,236 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-8699900213099915514_1171 to datanode(s) 127.0.0.1:38271
2013-10-31 16:11:39,236 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8751337026572452485_1158 blk_-4576546115426846666_1161 blk_4981770940444099633_1168 blk_-8992668016065045310_1160
2013-10-31 16:11:39,237 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-8751337026572452485_1158 blk_-4576546115426846666_1161 blk_4981770940444099633_1168 blk_-8992668016065045310_1160
2013-10-31 16:11:39,361 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-8699900213099915514_1171 to 127.0.0.1:38271
2013-10-31 16:11:39,361 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8992668016065045310_1160 file build/test/data/dfs/data/data4/current/blk_-8992668016065045310 for deletion
2013-10-31 16:11:39,362 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8751337026572452485_1158 file build/test/data/dfs/data/data3/current/blk_-8751337026572452485 for deletion
2013-10-31 16:11:39,362 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8992668016065045310_1160 at file build/test/data/dfs/data/data4/current/blk_-8992668016065045310
2013-10-31 16:11:39,362 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4576546115426846666_1161 file build/test/data/dfs/data/data3/current/blk_-4576546115426846666 for deletion
2013-10-31 16:11:39,362 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8751337026572452485_1158 at file build/test/data/dfs/data/data3/current/blk_-8751337026572452485
2013-10-31 16:11:39,363 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8699900213099915514_1171 src: /127.0.0.1:34906 dest: /127.0.0.1:38271
2013-10-31 16:11:39,363 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4576546115426846666_1161 at file build/test/data/dfs/data/data3/current/blk_-4576546115426846666
2013-10-31 16:11:39,363 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-8699900213099915514_1171 to /127.0.0.1:38271
2013-10-31 16:11:39,362 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4981770940444099633_1168 file build/test/data/dfs/data/data3/current/blk_4981770940444099633 for deletion
2013-10-31 16:11:39,364 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4981770940444099633_1168 at file build/test/data/dfs/data/data3/current/blk_4981770940444099633
2013-10-31 16:11:39,366 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8699900213099915514_1171 src: /127.0.0.1:34906 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:11:39,370 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8699900213099915514_1171 size 238055
2013-10-31 16:11:39,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,741 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split. New replication is 10
2013-10-31 16:11:39,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split dst=null perm=null
2013-10-31 16:11:39,747 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split. blk_-1537610290047334833_1172
2013-10-31 16:11:39,749 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:47940 dest: /127.0.0.1:47311
2013-10-31 16:11:39,751 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:34839 dest: /127.0.0.1:50942
2013-10-31 16:11:39,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:54945 dest: /127.0.0.1:41648
2013-10-31 16:11:39,754 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1537610290047334833_1172 src: /127.0.0.1:34910 dest: /127.0.0.1:38271
2013-10-31 16:11:39,758 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34910, dest: /127.0.0.1:38271, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1537610290047334833_1172, duration: 108177
2013-10-31 16:11:39,758 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,759 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54945, dest: /127.0.0.1:41648, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1537610290047334833_1172, duration: 962168
2013-10-31 16:11:39,759 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,760 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34839, dest: /127.0.0.1:50942, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1537610290047334833_1172, duration: 2182635
2013-10-31 16:11:39,760 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,760 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,761 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47940, dest: /127.0.0.1:47311, bytes: 1379, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1537610290047334833_1172, duration: 3155309
2013-10-31 16:11:39,761 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1537610290047334833_1172 terminating
2013-10-31 16:11:39,763 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,763 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split from client DFSClient_1457307213
2013-10-31 16:11:39,764 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split is closed by DFSClient_1457307213
2013-10-31 16:11:39,764 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,765 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1537610290047334833_1172 size 1379
2013-10-31 16:11:39,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,787 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo. blk_-8495043711673365996_1173
2013-10-31 16:11:39,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8495043711673365996_1173 src: /127.0.0.1:34842 dest: /127.0.0.1:50942
2013-10-31 16:11:39,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8495043711673365996_1173 src: /127.0.0.1:34912 dest: /127.0.0.1:38271
2013-10-31 16:11:39,791 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8495043711673365996_1173 src: /127.0.0.1:47946 dest: /127.0.0.1:47311
2013-10-31 16:11:39,794 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47946, dest: /127.0.0.1:47311, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8495043711673365996_1173, duration: 62347
2013-10-31 16:11:39,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8495043711673365996_1173 terminating
2013-10-31 16:11:39,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34912, dest: /127.0.0.1:38271, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8495043711673365996_1173, duration: 925256
2013-10-31 16:11:39,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8495043711673365996_1173 terminating
2013-10-31 16:11:39,796 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34842, dest: /127.0.0.1:50942, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8495043711673365996_1173, duration: 1739249
2013-10-31 16:11:39,796 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8495043711673365996_1173 terminating
2013-10-31 16:11:39,796 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8495043711673365996_1173 size 148
2013-10-31 16:11:39,800 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8495043711673365996_1173 size 148
2013-10-31 16:11:39,803 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:11:39,803 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:11:39,804 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8495043711673365996_1173 size 148
2013-10-31 16:11:39,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,832 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml. blk_5829433608470320000_1174
2013-10-31 16:11:39,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829433608470320000_1174 src: /127.0.0.1:54950 dest: /127.0.0.1:41648
2013-10-31 16:11:39,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829433608470320000_1174 src: /127.0.0.1:47948 dest: /127.0.0.1:47311
2013-10-31 16:11:39,837 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829433608470320000_1174 src: /127.0.0.1:34916 dest: /127.0.0.1:38271
2013-10-31 16:11:39,840 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34916, dest: /127.0.0.1:38271, bytes: 28244, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5829433608470320000_1174, duration: 107499
2013-10-31 16:11:39,840 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5829433608470320000_1174 terminating
2013-10-31 16:11:39,840 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47948, dest: /127.0.0.1:47311, bytes: 28244, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5829433608470320000_1174, duration: 956210
2013-10-31 16:11:39,841 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5829433608470320000_1174 terminating
2013-10-31 16:11:39,841 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54950, dest: /127.0.0.1:41648, bytes: 28244, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5829433608470320000_1174, duration: 2038163
2013-10-31 16:11:39,842 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5829433608470320000_1174 terminating
2013-10-31 16:11:39,844 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5829433608470320000_1174 size 28244
2013-10-31 16:11:39,844 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml from client DFSClient_1457307213
2013-10-31 16:11:39,845 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml is closed by DFSClient_1457307213
2013-10-31 16:11:39,845 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5829433608470320000_1174 size 28244
2013-10-31 16:11:39,846 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5829433608470320000_1174 size 28244
2013-10-31 16:11:39,849 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:11:39,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml dst=null perm=null
2013-10-31 16:11:39,859 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,861 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47951, bytes: 28468, op: HDFS_READ, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5829433608470320000_1174, duration: 377959
2013-10-31 16:11:39,865 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,871 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,877 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,878 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0016: nMaps=4 nReduces=0 max=-1
2013-10-31 16:11:39,878 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0016 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:11:39,878 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0016
2013-10-31 16:11:39,878 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0016 RESULT=SUCCESS
2013-10-31 16:11:39,879 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0016
2013-10-31 16:11:39,880 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] submitted hadoop job: job_20131031160444934_0016
2013-10-31 16:11:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,889 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:11:39,889 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:11:39,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,902 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml. blk_-1017080296582285540_1176
2013-10-31 16:11:39,903 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1017080296582285540_1176 src: /127.0.0.1:54955 dest: /127.0.0.1:41648
2013-10-31 16:11:39,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1017080296582285540_1176 src: /127.0.0.1:47953 dest: /127.0.0.1:47311
2013-10-31 16:11:39,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1017080296582285540_1176 src: /127.0.0.1:34852 dest: /127.0.0.1:50942
2013-10-31 16:11:39,908 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34852, dest: /127.0.0.1:50942, bytes: 28309, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1017080296582285540_1176, duration: 1740141
2013-10-31 16:11:39,908 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1017080296582285540_1176 terminating
2013-10-31 16:11:39,908 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1017080296582285540_1176 size 28309
2013-10-31 16:11:39,909 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47953, dest: /127.0.0.1:47311, bytes: 28309, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1017080296582285540_1176, duration: 1158899
2013-10-31 16:11:39,909 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1017080296582285540_1176 terminating
2013-10-31 16:11:39,909 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54955, dest: /127.0.0.1:41648, bytes: 28309, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1017080296582285540_1176, duration: 2762881
2013-10-31 16:11:39,909 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1017080296582285540_1176 terminating
2013-10-31 16:11:39,911 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml from client DFSClient_-1991226254
2013-10-31 16:11:39,911 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_conf.xml is closed by DFSClient_-1991226254
2013-10-31 16:11:39,911 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1017080296582285540_1176 size 28309
2013-10-31 16:11:39,913 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1017080296582285540_1176 size 28309
2013-10-31 16:11:39,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:39,929 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken. blk_7194689012869079137_1177
2013-10-31 16:11:39,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7194689012869079137_1177 src: /127.0.0.1:47955 dest: /127.0.0.1:47311
2013-10-31 16:11:39,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7194689012869079137_1177 src: /127.0.0.1:34923 dest: /127.0.0.1:38271
2013-10-31 16:11:39,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7194689012869079137_1177 src: /127.0.0.1:34855 dest: /127.0.0.1:50942
2013-10-31 16:11:39,936 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34855, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7194689012869079137_1177, duration: 64497
2013-10-31 16:11:39,937 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7194689012869079137_1177 terminating
2013-10-31 16:11:39,937 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7194689012869079137_1177 size 116
2013-10-31 16:11:39,937 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34923, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7194689012869079137_1177, duration: 815185
2013-10-31 16:11:39,938 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7194689012869079137_1177 terminating
2013-10-31 16:11:39,938 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47955, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7194689012869079137_1177, duration: 1640580
2013-10-31 16:11:39,939 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7194689012869079137_1177 terminating
2013-10-31 16:11:39,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7194689012869079137_1177 size 116
2013-10-31 16:11:39,942 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken from client DFSClient_1457307213
2013-10-31 16:11:39,942 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken is closed by DFSClient_1457307213
2013-10-31 16:11:39,943 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7194689012869079137_1177 size 116
2013-10-31 16:11:39,949 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken
2013-10-31 16:11:39,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.splitmetainfo dst=null perm=null
2013-10-31 16:11:39,953 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34856, bytes: 152, op: HDFS_READ, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8495043711673365996_1173, duration: 272890
2013-10-31 16:11:39,954 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0016 = 52. Number of splits = 4
2013-10-31 16:11:39,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,956 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:11:39,957 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0016 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:11:39,958 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0016 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 16:11:39,974 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8992668016065045310_1160 file build/test/data/dfs/data/data5/current/blk_-8992668016065045310 for deletion
2013-10-31 16:11:39,974 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8751337026572452485_1158 file build/test/data/dfs/data/data5/current/blk_-8751337026572452485 for deletion
2013-10-31 16:11:39,974 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8992668016065045310_1160 at file build/test/data/dfs/data/data5/current/blk_-8992668016065045310
2013-10-31 16:11:39,975 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4576546115426846666_1161 file build/test/data/dfs/data/data6/current/blk_-4576546115426846666 for deletion
2013-10-31 16:11:39,975 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8751337026572452485_1158 at file build/test/data/dfs/data/data5/current/blk_-8751337026572452485
2013-10-31 16:11:39,975 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4576546115426846666_1161 at file build/test/data/dfs/data/data6/current/blk_-4576546115426846666
2013-10-31 16:11:39,975 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4981770940444099633_1168 file build/test/data/dfs/data/data5/current/blk_4981770940444099633 for deletion
2013-10-31 16:11:39,976 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4981770940444099633_1168 at file build/test/data/dfs/data/data5/current/blk_4981770940444099633
2013-10-31 16:11:40,945 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0016_m_000005_0' to tip task_20131031160444934_0016_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:40,951 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:11:40,952 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:40,952 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000005_0 which needs 1 slots
2013-10-31 16:11:40,952 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0015 being deleted.
2013-10-31 16:11:40,952 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000005_0 which needs 1 slots
2013-10-31 16:11:40,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken dst=null perm=null
2013-10-31 16:11:40,961 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34926, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7194689012869079137_1177, duration: 303041
2013-10-31 16:11:40,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml dst=null perm=null
2013-10-31 16:11:40,975 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54964, bytes: 28468, op: HDFS_READ, cliID: DFSClient_876369485, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5829433608470320000_1174, duration: 432809
2013-10-31 16:11:41,005 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:41,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar dst=null perm=null
2013-10-31 16:11:41,030 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54965, bytes: 239915, op: HDFS_READ, cliID: DFSClient_876369485, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8699900213099915514_1171, duration: 1358248
2013-10-31 16:11:41,140 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_2092185245
2013-10-31 16:11:41,140 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_2092185245 spawned.
2013-10-31 16:11:41,141 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000005_0/taskjvm.sh
2013-10-31 16:11:41,814 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:41,814 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0015 being deleted.
2013-10-31 16:11:42,237 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-8751337026572452485_1158 blk_-4576546115426846666_1161
2013-10-31 16:11:42,237 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_4981770940444099633_1168 blk_-8992668016065045310_1160
2013-10-31 16:11:42,472 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_2092185245 given task: attempt_20131031160444934_0016_m_000005_0
2013-10-31 16:11:43,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:43,923 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0015
2013-10-31 16:11:43,923 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0015_m_000000_0 not found in cache
2013-10-31 16:11:43,924 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0015_m_000001_0 not found in cache
2013-10-31 16:11:43,924 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0015 for user-log deletion with retainTimeStamp:1383322303924
2013-10-31 16:11:44,151 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0015_m_1172956060 since job job_20131031160444934_0015 is dead
2013-10-31 16:11:44,162 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18837 with signal TERM. Exit code 0
2013-10-31 16:11:44,333 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:44,333 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:44,333 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:44,333 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0015_m_1172956060 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:11:44,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8992668016065045310_1160 file build/test/data/dfs/data/data1/current/blk_-8992668016065045310 for deletion
2013-10-31 16:11:44,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4981770940444099633_1168 file build/test/data/dfs/data/data2/current/blk_4981770940444099633 for deletion
2013-10-31 16:11:44,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8992668016065045310_1160 at file build/test/data/dfs/data/data1/current/blk_-8992668016065045310
2013-10-31 16:11:44,764 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4981770940444099633_1168 at file build/test/data/dfs/data/data2/current/blk_4981770940444099633
2013-10-31 16:11:44,919 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0015_m_1034060197 since job job_20131031160444934_0015 is dead
2013-10-31 16:11:44,929 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18710 with signal TERM. Exit code 0
2013-10-31 16:11:44,964 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8751337026572452485_1158 file build/test/data/dfs/data/data8/current/blk_-8751337026572452485 for deletion
2013-10-31 16:11:44,965 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4576546115426846666_1161 file build/test/data/dfs/data/data7/current/blk_-4576546115426846666 for deletion
2013-10-31 16:11:44,965 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8751337026572452485_1158 at file build/test/data/dfs/data/data8/current/blk_-8751337026572452485
2013-10-31 16:11:44,965 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4576546115426846666_1161 at file build/test/data/dfs/data/data7/current/blk_-4576546115426846666
2013-10-31 16:11:45,104 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:11:45,104 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:11:45,104 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:11:45,104 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0015_m_1034060197 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:11:45,914 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000005_0 0.0% setup
2013-10-31 16:11:45,916 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000005_0 is done.
2013-10-31 16:11:45,917 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000005_0 was -1
2013-10-31 16:11:45,917 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:46,958 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000005_0' has completed task_20131031160444934_0016_m_000005 successfully.
2013-10-31 16:11:47,072 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000000_0' to tip task_20131031160444934_0016_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:11:47,073 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000000
2013-10-31 16:11:47,075 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:11:47,075 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000000_0 which needs 1 slots
2013-10-31 16:11:47,075 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000000_0 which needs 1 slots
2013-10-31 16:11:47,162 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-768505707
2013-10-31 16:11:47,163 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-768505707 spawned.
2013-10-31 16:11:47,166 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000000_0/taskjvm.sh
2013-10-31 16:11:47,822 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000001_0' to tip task_20131031160444934_0016_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:11:47,823 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000001
2013-10-31 16:11:47,824 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:11:47,825 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000001_0 which needs 1 slots
2013-10-31 16:11:47,825 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000001_0 which needs 1 slots
2013-10-31 16:11:47,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken dst=null perm=null
2013-10-31 16:11:47,831 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47966, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7194689012869079137_1177, duration: 142507
2013-10-31 16:11:47,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml dst=null perm=null
2013-10-31 16:11:47,841 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34935, bytes: 28468, op: HDFS_READ, cliID: DFSClient_-1217873459, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5829433608470320000_1174, duration: 477032
2013-10-31 16:11:47,862 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:47,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar dst=null perm=null
2013-10-31 16:11:47,875 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34936, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1217873459, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8699900213099915514_1171, duration: 636581
2013-10-31 16:11:47,927 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-2031316218
2013-10-31 16:11:47,927 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-2031316218 spawned.
2013-10-31 16:11:47,928 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000001_0/taskjvm.sh
2013-10-31 16:11:47,934 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000002_0' to tip task_20131031160444934_0016_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:11:47,934 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000002
2013-10-31 16:11:47,935 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:11:47,935 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000002_0 which needs 1 slots
2013-10-31 16:11:47,935 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000002_0 which needs 1 slots
2013-10-31 16:11:47,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken dst=null perm=null
2013-10-31 16:11:47,939 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47970, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7194689012869079137_1177, duration: 136319
2013-10-31 16:11:47,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml dst=null perm=null
2013-10-31 16:11:47,943 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34939, bytes: 28468, op: HDFS_READ, cliID: DFSClient_-2100221565, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5829433608470320000_1174, duration: 153701
2013-10-31 16:11:47,955 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:47,969 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0016_m_000003_0' to tip task_20131031160444934_0016_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:11:47,969 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0016_m_000003
2013-10-31 16:11:47,970 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:11:47,970 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000003_0 which needs 1 slots
2013-10-31 16:11:47,970 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000003_0 which needs 1 slots
2013-10-31 16:11:47,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016/jobToken dst=null perm=null
2013-10-31 16:11:47,974 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34940, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7194689012869079137_1177, duration: 144422
2013-10-31 16:11:47,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar dst=null perm=null
2013-10-31 16:11:47,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.xml dst=null perm=null
2013-10-31 16:11:47,979 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54978, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2100221565, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8699900213099915514_1171, duration: 691957
2013-10-31 16:11:47,979 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47976, bytes: 28468, op: HDFS_READ, cliID: DFSClient_753679354, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5829433608470320000_1174, duration: 161069
2013-10-31 16:11:47,991 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-768505707 given task: attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:47,992 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:11:48,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.jar dst=null perm=null
2013-10-31 16:11:48,006 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47977, bytes: 239915, op: HDFS_READ, cliID: DFSClient_753679354, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8699900213099915514_1171, duration: 740192
2013-10-31 16:11:48,257 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_1360879598
2013-10-31 16:11:48,257 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-383608023
2013-10-31 16:11:48,258 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_1360879598 spawned.
2013-10-31 16:11:48,259 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-383608023 spawned.
2013-10-31 16:11:48,260 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000002_0/taskjvm.sh
2013-10-31 16:11:48,261 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000003_0/taskjvm.sh
2013-10-31 16:11:48,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split dst=null perm=null
2013-10-31 16:11:48,808 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54982, bytes: 1391, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1537610290047334833_1172, duration: 174886
2013-10-31 16:11:48,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:11:48,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:48,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:49,037 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-2031316218 given task: attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:49,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:49,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:49,124 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:47981, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 136729
2013-10-31 16:11:49,128 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34880, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 138847
2013-10-31 16:11:49,136 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000. blk_-1338531806484752498_1178
2013-10-31 16:11:49,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1338531806484752498_1178 src: /127.0.0.1:34881 dest: /127.0.0.1:50942
2013-10-31 16:11:49,161 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1338531806484752498_1178 src: /127.0.0.1:47984 dest: /127.0.0.1:47311
2013-10-31 16:11:49,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1338531806484752498_1178 src: /127.0.0.1:34952 dest: /127.0.0.1:38271
2013-10-31 16:11:49,164 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34952, dest: /127.0.0.1:38271, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1338531806484752498_1178, duration: 1166512
2013-10-31 16:11:49,165 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1338531806484752498_1178 terminating
2013-10-31 16:11:49,165 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47984, dest: /127.0.0.1:47311, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1338531806484752498_1178, duration: 1639266
2013-10-31 16:11:49,165 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1338531806484752498_1178 terminating
2013-10-31 16:11:49,165 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34881, dest: /127.0.0.1:50942, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1338531806484752498_1178, duration: 2026898
2013-10-31 16:11:49,166 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1338531806484752498_1178 terminating
2013-10-31 16:11:49,169 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1338531806484752498_1178 size 96
2013-10-31 16:11:49,169 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1338531806484752498_1178 size 96
2013-10-31 16:11:49,169 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1338531806484752498_1178 size 96
2013-10-31 16:11:49,470 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_1360879598 given task: attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:49,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split dst=null perm=null
2013-10-31 16:11:49,537 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34887, bytes: 1391, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1537610290047334833_1172, duration: 173499
2013-10-31 16:11:49,563 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-383608023 given task: attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:49,567 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:49,567 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:49,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:11:49,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34957, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4001027560673372033_1084, duration: 124479
2013-10-31 16:11:49,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:49,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:49,615 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:49,615 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000000_0 0.0%
2013-10-31 16:11:49,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:49,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:49,814 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:54994, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 128050
2013-10-31 16:11:49,824 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001. blk_-3174711439536184192_1179
2013-10-31 16:11:49,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3174711439536184192_1179 src: /127.0.0.1:34890 dest: /127.0.0.1:50942
2013-10-31 16:11:49,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3174711439536184192_1179 src: /127.0.0.1:47993 dest: /127.0.0.1:47311
2013-10-31 16:11:49,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3174711439536184192_1179 src: /127.0.0.1:54997 dest: /127.0.0.1:41648
2013-10-31 16:11:49,852 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:54997, dest: /127.0.0.1:41648, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3174711439536184192_1179, duration: 1110346
2013-10-31 16:11:49,852 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3174711439536184192_1179 terminating
2013-10-31 16:11:49,852 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47993, dest: /127.0.0.1:47311, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3174711439536184192_1179, duration: 1486321
2013-10-31 16:11:49,852 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3174711439536184192_1179 terminating
2013-10-31 16:11:49,852 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34890, dest: /127.0.0.1:50942, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3174711439536184192_1179, duration: 1879149
2013-10-31 16:11:49,852 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3174711439536184192_1179 terminating
2013-10-31 16:11:49,854 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3174711439536184192_1179 size 56
2013-10-31 16:11:49,854 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3174711439536184192_1179 size 56
2013-10-31 16:11:49,856 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3174711439536184192_1179 size 56
2013-10-31 16:11:49,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split dst=null perm=null
2013-10-31 16:11:49,989 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34964, bytes: 875, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1537610290047334833_1172, duration: 167058
2013-10-31 16:11:50,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:11:50,028 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34896, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 103975
2013-10-31 16:11:50,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:50,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:50,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016/job.split dst=null perm=null
2013-10-31 16:11:50,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34897, bytes: 359, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1537610290047334833_1172, duration: 120740
2013-10-31 16:11:50,076 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000000_0
2013-10-31 16:11:50,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:11:50,098 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34898, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 115463
2013-10-31 16:11:50,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:50,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:50,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:50,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:50,249 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48001, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 124865
2013-10-31 16:11:50,254 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:50,254 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:50,259 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002. blk_-6105123511850759531_1181
2013-10-31 16:11:50,282 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6105123511850759531_1181 src: /127.0.0.1:55005 dest: /127.0.0.1:41648
2013-10-31 16:11:50,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6105123511850759531_1181 src: /127.0.0.1:48003 dest: /127.0.0.1:47311
2013-10-31 16:11:50,284 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6105123511850759531_1181 src: /127.0.0.1:34902 dest: /127.0.0.1:50942
2013-10-31 16:11:50,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34902, dest: /127.0.0.1:50942, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6105123511850759531_1181, duration: 1122754
2013-10-31 16:11:50,286 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6105123511850759531_1181 terminating
2013-10-31 16:11:50,287 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48003, dest: /127.0.0.1:47311, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6105123511850759531_1181, duration: 1656681
2013-10-31 16:11:50,287 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6105123511850759531_1181 terminating
2013-10-31 16:11:50,287 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55005, dest: /127.0.0.1:41648, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 2179614
2013-10-31 16:11:50,287 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6105123511850759531_1181 terminating
2013-10-31 16:11:50,291 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6105123511850759531_1181 size 72
2013-10-31 16:11:50,291 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6105123511850759531_1181 size 72
2013-10-31 16:11:50,291 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6105123511850759531_1181 size 72
2013-10-31 16:11:50,301 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:50,301 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000001_0 0.0%
2013-10-31 16:11:50,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:50,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:11:50,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48005, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1539762991683523844_1085, duration: 133062
2013-10-31 16:11:50,331 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003. blk_-4235132370181600024_1181
2013-10-31 16:11:50,353 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235132370181600024_1181 src: /127.0.0.1:34973 dest: /127.0.0.1:38271
2013-10-31 16:11:50,354 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235132370181600024_1181 src: /127.0.0.1:55010 dest: /127.0.0.1:41648
2013-10-31 16:11:50,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4235132370181600024_1181 src: /127.0.0.1:48008 dest: /127.0.0.1:47311
2013-10-31 16:11:50,357 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48008, dest: /127.0.0.1:47311, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4235132370181600024_1181, duration: 1188732
2013-10-31 16:11:50,357 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4235132370181600024_1181 terminating
2013-10-31 16:11:50,357 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4235132370181600024_1181 size 72
2013-10-31 16:11:50,358 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55010, dest: /127.0.0.1:41648, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4235132370181600024_1181, duration: 1956439
2013-10-31 16:11:50,358 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4235132370181600024_1181 terminating
2013-10-31 16:11:50,359 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34973, dest: /127.0.0.1:38271, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0016_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4235132370181600024_1181, duration: 2948088
2013-10-31 16:11:50,360 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4235132370181600024_1181 terminating
2013-10-31 16:11:50,360 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4235132370181600024_1181 size 72
2013-10-31 16:11:50,361 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:50,361 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:50,361 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4235132370181600024_1181 size 72
2013-10-31 16:11:50,412 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:50,412 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000003_0 0.0%
2013-10-31 16:11:50,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0 dst=null perm=null
2013-10-31 16:11:50,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:50,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:50,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000000_0 dst=null perm=null
2013-10-31 16:11:50,689 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:50,690 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:50,749 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0016_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:11:50,749 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000002_0 0.0%
2013-10-31 16:11:50,830 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000001_0
2013-10-31 16:11:50,939 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000002_0
2013-10-31 16:11:50,973 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0016_m_000003_0
2013-10-31 16:11:51,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0 dst=null perm=null
2013-10-31 16:11:51,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:51,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:51,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0 dst=null perm=null
2013-10-31 16:11:51,645 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 960 Total time for transactions(ms): 17Number of transactions batched in Syncs: 89 Number of syncs: 684 SyncTimes(ms): 27108 3567
2013-10-31 16:11:51,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:51,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000001_0 dst=null perm=null
2013-10-31 16:11:51,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:51,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000003_0 dst=null perm=null
2013-10-31 16:11:51,735 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+13
2013-10-31 16:11:51,737 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000000_0 is done.
2013-10-31 16:11:51,737 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000000_0 was -1
2013-10-31 16:11:51,737 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:51,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0 dst=null perm=null
2013-10-31 16:11:51,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:11:51,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:51,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary/_attempt_20131031160444934_0016_m_000002_0 dst=null perm=null
2013-10-31 16:11:52,075 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0016_m_000005_0
2013-10-31 16:11:52,076 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0016_m_000005_0
2013-10-31 16:11:52,076 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000005_0 not found in cache
2013-10-31 16:11:52,463 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:13+13
2013-10-31 16:11:52,465 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000001_0 is done.
2013-10-31 16:11:52,465 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000001_0 was -1
2013-10-31 16:11:52,465 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:52,896 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+13
2013-10-31 16:11:52,898 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000002_0 is done.
2013-10-31 16:11:52,898 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000002_0 was -1
2013-10-31 16:11:52,899 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:52,985 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:39+13
2013-10-31 16:11:52,986 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000003_0 is done.
2013-10-31 16:11:52,986 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000003_0 was -1
2013-10-31 16:11:52,986 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:53,078 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000000_0' has completed task_20131031160444934_0016_m_000000 successfully.
2013-10-31 16:11:53,832 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000001_0' has completed task_20131031160444934_0016_m_000001 successfully.
2013-10-31 16:11:53,942 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000002_0' has completed task_20131031160444934_0016_m_000002 successfully.
2013-10-31 16:11:53,977 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000003_0' has completed task_20131031160444934_0016_m_000003 successfully.
2013-10-31 16:11:53,981 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0016_m_000004_0' to tip task_20131031160444934_0016_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:11:53,983 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0016_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:11:53,983 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0016_m_000004_0 which needs 1 slots
2013-10-31 16:11:53,984 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0016_m_000004_0 which needs 1 slots
2013-10-31 16:11:54,022 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0016_m_-890241865
2013-10-31 16:11:54,023 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0016_m_-890241865 spawned.
2013-10-31 16:11:54,026 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0016/attempt_20131031160444934_0016_m_000004_0/taskjvm.sh
2013-10-31 16:11:54,900 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0016_m_-890241865 given task: attempt_20131031160444934_0016_m_000004_0
2013-10-31 16:11:55,412 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000004_0 0.0%
2013-10-31 16:11:55,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary dst=null perm=null
2013-10-31 16:11:55,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:11:55,434 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_SUCCESS from client DFSClient_attempt_20131031160444934_0016_m_000004_0
2013-10-31 16:11:55,434 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0016_m_000004_0
2013-10-31 16:11:55,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:55,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:55,442 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8699900213099915514 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,442 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:55,442 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:55,442 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,442 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1537610290047334833 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,442 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8495043711673365996 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:11:55,443 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8495043711673365996 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,443 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8495043711673365996 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,443 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5829433608470320000 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:11:55,443 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5829433608470320000 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:11:55,443 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5829433608470320000 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:11:55,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0016 dst=null perm=null
2013-10-31 16:11:56,923 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3591799862562816615_1055
2013-10-31 16:11:57,240 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_5829433608470320000_1174 blk_-1537610290047334833_1172 blk_-8699900213099915514_1171
2013-10-31 16:11:57,240 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-1537610290047334833_1172 blk_-8699900213099915514_1171 blk_-8495043711673365996_1173
2013-10-31 16:11:57,980 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data6/current/blk_-8699900213099915514 for deletion
2013-10-31 16:11:57,980 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data5/current/blk_-1537610290047334833 for deletion
2013-10-31 16:11:57,980 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5829433608470320000_1174 file build/test/data/dfs/data/data6/current/blk_5829433608470320000 for deletion
2013-10-31 16:11:57,981 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data5/current/blk_-1537610290047334833
2013-10-31 16:11:57,980 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data6/current/blk_-8699900213099915514
2013-10-31 16:11:57,981 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5829433608470320000_1174 at file build/test/data/dfs/data/data6/current/blk_5829433608470320000
2013-10-31 16:11:58,341 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0016_m_000004_0 0.0% cleanup
2013-10-31 16:11:58,343 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0016_m_000004_0 is done.
2013-10-31 16:11:58,343 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0016_m_000004_0 was -1
2013-10-31 16:11:58,343 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:11:59,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data8/current/blk_-8699900213099915514 for deletion
2013-10-31 16:11:59,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8495043711673365996_1173 file build/test/data/dfs/data/data8/current/blk_-8495043711673365996 for deletion
2013-10-31 16:11:59,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data8/current/blk_-8699900213099915514
2013-10-31 16:11:59,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data7/current/blk_-1537610290047334833 for deletion
2013-10-31 16:11:59,972 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8495043711673365996_1173 at file build/test/data/dfs/data/data8/current/blk_-8495043711673365996
2013-10-31 16:11:59,972 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data7/current/blk_-1537610290047334833
2013-10-31 16:11:59,991 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0016_m_000004_0' has completed task_20131031160444934_0016_m_000004 successfully.
2013-10-31 16:11:59,992 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0016 has completed successfully.
2013-10-31 16:11:59,992 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0016,submitTime=1383235899852,launchTime=1383235899957,firstMapTaskLaunchTime=1383235907071,firstJobSetupTaskLaunchTime=1383235900945,firstJobCleanupTaskLaunchTime=1383235913980,finishTime=1383235919992,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[87C629D81DF64331889EA15A88EA787E/20861E5A5D2A45D58F9CD7EC15054E84] lhs*rhs/(1/1) ...ieldedpipesplatform/cross
2013-10-31 16:11:59,998 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5. blk_3560413497848393575_1182
2013-10-31 16:12:00,000 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560413497848393575_1182 src: /127.0.0.1:55016 dest: /127.0.0.1:41648
2013-10-31 16:12:00,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560413497848393575_1182 src: /127.0.0.1:48014 dest: /127.0.0.1:47311
2013-10-31 16:12:00,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560413497848393575_1182 src: /127.0.0.1:34982 dest: /127.0.0.1:38271
2013-10-31 16:12:00,007 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34982, dest: /127.0.0.1:38271, bytes: 22626, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3560413497848393575_1182, duration: 117596
2013-10-31 16:12:00,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3560413497848393575_1182 terminating
2013-10-31 16:12:00,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48014, dest: /127.0.0.1:47311, bytes: 22626, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3560413497848393575_1182, duration: 1018884
2013-10-31 16:12:00,009 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3560413497848393575_1182 terminating
2013-10-31 16:12:00,009 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55016, dest: /127.0.0.1:41648, bytes: 22626, op: HDFS_WRITE, cliID: DFSClient_-1991226254, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3560413497848393575_1182, duration: 2174543
2013-10-31 16:12:00,010 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3560413497848393575_1182 size 22626
2013-10-31 16:12:00,010 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3560413497848393575_1182 terminating
2013-10-31 16:12:00,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3560413497848393575_1182 size 22626
2013-10-31 16:12:00,016 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5 from client DFSClient_-1991226254
2013-10-31 16:12:00,017 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_logs/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5 is closed by DFSClient_-1991226254
2013-10-31 16:12:00,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3560413497848393575_1182 size 22626
2013-10-31 16:12:00,025 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0016_1383235899852_hadoop_%5B87C629D81DF64331889EA15A88EA787E%2F20861E5A5D2A45D5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:00,026 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000003_0'
2013-10-31 16:12:00,026 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000004_0'
2013-10-31 16:12:00,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7194689012869079137 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:00,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7194689012869079137 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:00,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7194689012869079137 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:00,031 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0016_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:00,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0016 dst=null perm=null
2013-10-31 16:12:00,035 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/_temporary
2013-10-31 16:12:00,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross dst=null perm=null
2013-10-31 16:12:00,045 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 16:12:00,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2013-10-31 16:12:00,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2013-10-31 16:12:00,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2013-10-31 16:12:00,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2013-10-31 16:12:00,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2013-10-31 16:12:00,052 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34915, bytes: 100, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1338531806484752498_1178, duration: 138120
2013-10-31 16:12:00,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2013-10-31 16:12:00,055 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34916, bytes: 60, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3174711439536184192_1179, duration: 287977
2013-10-31 16:12:00,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2013-10-31 16:12:00,058 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55022, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 278563
2013-10-31 16:12:00,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2013-10-31 16:12:00,060 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48020, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4235132370181600024_1181, duration: 269643
2013-10-31 16:12:00,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross dst=null perm=null
2013-10-31 16:12:00,068 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 16:12:00,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2013-10-31 16:12:00,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2013-10-31 16:12:00,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2013-10-31 16:12:00,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2013-10-31 16:12:00,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2013-10-31 16:12:00,075 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34988, bytes: 100, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1338531806484752498_1178, duration: 265937
2013-10-31 16:12:00,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2013-10-31 16:12:00,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34920, bytes: 60, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3174711439536184192_1179, duration: 153687
2013-10-31 16:12:00,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2013-10-31 16:12:00,081 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55026, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 416712
2013-10-31 16:12:00,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2013-10-31 16:12:00,083 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55027, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4235132370181600024_1181, duration: 151348
2013-10-31 16:12:00,083 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/cross
2013-10-31 16:12:00,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross dst=null perm=null
2013-10-31 16:12:00,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2013-10-31 16:12:00,090 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34923, bytes: 100, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1338531806484752498_1178, duration: 144821
2013-10-31 16:12:00,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2013-10-31 16:12:00,093 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55029, bytes: 60, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3174711439536184192_1179, duration: 144454
2013-10-31 16:12:00,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2013-10-31 16:12:00,096 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55030, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6105123511850759531_1181, duration: 143922
2013-10-31 16:12:00,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2013-10-31 16:12:00,100 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:34995, bytes: 76, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4235132370181600024_1181, duration: 274731
2013-10-31 16:12:00,118 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:12:00,118 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:12:00,129 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:12:00,130 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:12:00,130 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:12:00,131 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join"]
2013-10-31 16:12:00,131 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:12:00,132 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:12:00,132 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:12:00,133 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...fieldedpipesplatform/join
2013-10-31 16:12:00,136 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:12:00,136 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:12:00,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:00,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:12:00,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,153 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar. blk_5312415671512961170_1183
2013-10-31 16:12:00,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:48029 dest: /127.0.0.1:47311
2013-10-31 16:12:00,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:55033 dest: /127.0.0.1:41648
2013-10-31 16:12:00,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:34929 dest: /127.0.0.1:50942
2013-10-31 16:12:00,167 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34929, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5312415671512961170_1183, duration: 6523817
2013-10-31 16:12:00,168 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5312415671512961170_1183 terminating
2013-10-31 16:12:00,168 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55033, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5312415671512961170_1183, duration: 7343592
2013-10-31 16:12:00,169 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:00,169 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5312415671512961170_1183 terminating
2013-10-31 16:12:00,169 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48029, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5312415671512961170_1183, duration: 8372675
2013-10-31 16:12:00,169 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:00,170 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5312415671512961170_1183 terminating
2013-10-31 16:12:00,171 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:00,172 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar from client DFSClient_1457307213
2013-10-31 16:12:00,172 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar is closed by DFSClient_1457307213
2013-10-31 16:12:00,177 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar. New replication is 10
2013-10-31 16:12:00,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar dst=null perm=null
2013-10-31 16:12:00,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,186 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:12:00,191 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:00,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:00,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:00,206 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split. New replication is 10
2013-10-31 16:12:00,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=null
2013-10-31 16:12:00,212 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split. blk_7955453648049656030_1184
2013-10-31 16:12:00,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:55035 dest: /127.0.0.1:41648
2013-10-31 16:12:00,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:35000 dest: /127.0.0.1:38271
2013-10-31 16:12:00,217 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:48034 dest: /127.0.0.1:47311
2013-10-31 16:12:00,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7955453648049656030_1184 src: /127.0.0.1:34933 dest: /127.0.0.1:50942
2013-10-31 16:12:00,222 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34933, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7955453648049656030_1184, duration: 109289
2013-10-31 16:12:00,223 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,223 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,223 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48034, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 1033050
2013-10-31 16:12:00,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35000, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7955453648049656030_1184, duration: 2219818
2013-10-31 16:12:00,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55035, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7955453648049656030_1184, duration: 3020165
2013-10-31 16:12:00,226 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,226 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7955453648049656030_1184 terminating
2013-10-31 16:12:00,227 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split from client DFSClient_1457307213
2013-10-31 16:12:00,228 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split is closed by DFSClient_1457307213
2013-10-31 16:12:00,228 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7955453648049656030_1184 size 1732
2013-10-31 16:12:00,241 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_5312415671512961170_1183 to datanode(s) 127.0.0.1:38271
2013-10-31 16:12:00,241 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_5829433608470320000_1174 blk_7194689012869079137_1177 blk_-1537610290047334833_1172 blk_-8699900213099915514_1171 blk_-8495043711673365996_1173
2013-10-31 16:12:00,241 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_7194689012869079137_1177
2013-10-31 16:12:00,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data4/current/blk_-8699900213099915514 for deletion
2013-10-31 16:12:00,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8495043711673365996_1173 file build/test/data/dfs/data/data4/current/blk_-8495043711673365996 for deletion
2013-10-31 16:12:00,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data4/current/blk_-8699900213099915514
2013-10-31 16:12:00,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data3/current/blk_-1537610290047334833 for deletion
2013-10-31 16:12:00,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8495043711673365996_1173 at file build/test/data/dfs/data/data4/current/blk_-8495043711673365996
2013-10-31 16:12:00,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5829433608470320000_1174 file build/test/data/dfs/data/data3/current/blk_5829433608470320000 for deletion
2013-10-31 16:12:00,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data3/current/blk_-1537610290047334833
2013-10-31 16:12:00,370 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7194689012869079137_1177 file build/test/data/dfs/data/data3/current/blk_7194689012869079137 for deletion
2013-10-31 16:12:00,370 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5829433608470320000_1174 at file build/test/data/dfs/data/data3/current/blk_5829433608470320000
2013-10-31 16:12:00,370 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7194689012869079137_1177 at file build/test/data/dfs/data/data3/current/blk_7194689012869079137
2013-10-31 16:12:02,089 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000000_0'
2013-10-31 16:12:02,090 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000005_0'
2013-10-31 16:12:02,843 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000001_0'
2013-10-31 16:12:02,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,953 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0016_m_000002_0'
2013-10-31 16:12:02,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,961 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo. blk_8736535815943837723_1185
2013-10-31 16:12:02,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8736535815943837723_1185 src: /127.0.0.1:35004 dest: /127.0.0.1:38271
2013-10-31 16:12:02,964 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8736535815943837723_1185 src: /127.0.0.1:34936 dest: /127.0.0.1:50942
2013-10-31 16:12:02,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8736535815943837723_1185 src: /127.0.0.1:48039 dest: /127.0.0.1:47311
2013-10-31 16:12:02,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48039, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8736535815943837723_1185, duration: 705835
2013-10-31 16:12:02,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8736535815943837723_1185 terminating
2013-10-31 16:12:02,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34936, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8736535815943837723_1185, duration: 1058702
2013-10-31 16:12:02,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8736535815943837723_1185 terminating
2013-10-31 16:12:02,968 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8736535815943837723_1185 size 183
2013-10-31 16:12:02,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35004, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8736535815943837723_1185, duration: 988585
2013-10-31 16:12:02,969 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8736535815943837723_1185 terminating
2013-10-31 16:12:02,971 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8736535815943837723_1185 size 183
2013-10-31 16:12:02,971 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:12:02,971 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:12:02,972 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_5312415671512961170_1183 to 127.0.0.1:38271
2013-10-31 16:12:02,972 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7194689012869079137_1177 file build/test/data/dfs/data/data8/current/blk_7194689012869079137 for deletion
2013-10-31 16:12:02,973 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7194689012869079137_1177 at file build/test/data/dfs/data/data8/current/blk_7194689012869079137
2013-10-31 16:12:02,973 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_5312415671512961170_1183 to /127.0.0.1:38271
2013-10-31 16:12:02,973 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8736535815943837723_1185 size 183
2013-10-31 16:12:02,973 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5312415671512961170_1183 src: /127.0.0.1:35007 dest: /127.0.0.1:38271
2013-10-31 16:12:02,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5312415671512961170_1183 src: /127.0.0.1:35007 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:12:02,978 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5312415671512961170_1183 size 238055
2013-10-31 16:12:02,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:02,994 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml. blk_-892002836518062520_1186
2013-10-31 16:12:02,996 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-892002836518062520_1186 src: /127.0.0.1:48041 dest: /127.0.0.1:47311
2013-10-31 16:12:02,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-892002836518062520_1186 src: /127.0.0.1:35009 dest: /127.0.0.1:38271
2013-10-31 16:12:02,998 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-892002836518062520_1186 src: /127.0.0.1:34941 dest: /127.0.0.1:50942
2013-10-31 16:12:03,000 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34941, dest: /127.0.0.1:50942, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-892002836518062520_1186, duration: 889215
2013-10-31 16:12:03,001 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-892002836518062520_1186 terminating
2013-10-31 16:12:03,001 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35009, dest: /127.0.0.1:38271, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-892002836518062520_1186, duration: 991385
2013-10-31 16:12:03,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-892002836518062520_1186 size 28289
2013-10-31 16:12:03,001 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-892002836518062520_1186 terminating
2013-10-31 16:12:03,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-892002836518062520_1186 size 28289
2013-10-31 16:12:03,001 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48041, dest: /127.0.0.1:47311, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 1086103
2013-10-31 16:12:03,002 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-892002836518062520_1186 size 28289
2013-10-31 16:12:03,002 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-892002836518062520_1186 terminating
2013-10-31 16:12:03,006 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml from client DFSClient_1457307213
2013-10-31 16:12:03,006 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml is closed by DFSClient_1457307213
2013-10-31 16:12:03,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml dst=null perm=null
2013-10-31 16:12:03,027 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48045, bytes: 28513, op: HDFS_READ, cliID: DFSClient_244823367, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 480971
2013-10-31 16:12:03,035 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0017: nMaps=5 nReduces=0 max=-1
2013-10-31 16:12:03,035 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0017 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:12:03,035 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0017 RESULT=SUCCESS
2013-10-31 16:12:03,035 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0017
2013-10-31 16:12:03,036 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0017
2013-10-31 16:12:03,037 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0017
2013-10-31 16:12:03,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:03,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:03,067 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml. blk_-398564686101140297_1188
2013-10-31 16:12:03,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-398564686101140297_1188 src: /127.0.0.1:48046 dest: /127.0.0.1:47311
2013-10-31 16:12:03,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-398564686101140297_1188 src: /127.0.0.1:55050 dest: /127.0.0.1:41648
2013-10-31 16:12:03,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-398564686101140297_1188 src: /127.0.0.1:34946 dest: /127.0.0.1:50942
2013-10-31 16:12:03,076 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34946, dest: /127.0.0.1:50942, bytes: 28354, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-398564686101140297_1188, duration: 2031114
2013-10-31 16:12:03,076 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-398564686101140297_1188 terminating
2013-10-31 16:12:03,076 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55050, dest: /127.0.0.1:41648, bytes: 28354, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-398564686101140297_1188, duration: 1915793
2013-10-31 16:12:03,076 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-398564686101140297_1188 terminating
2013-10-31 16:12:03,076 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48046, dest: /127.0.0.1:47311, bytes: 28354, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-398564686101140297_1188, duration: 1659167
2013-10-31 16:12:03,077 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-398564686101140297_1188 terminating
2013-10-31 16:12:03,079 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-398564686101140297_1188 size 28354
2013-10-31 16:12:03,080 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-398564686101140297_1188 size 28354
2013-10-31 16:12:03,081 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-398564686101140297_1188 size 28354
2013-10-31 16:12:03,242 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_5829433608470320000_1174 blk_7194689012869079137_1177 blk_-1537610290047334833_1172 blk_-8699900213099915514_1171 blk_-8495043711673365996_1173
2013-10-31 16:12:03,481 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml from client DFSClient_244823367
2013-10-31 16:12:03,481 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_conf.xml is closed by DFSClient_244823367
2013-10-31 16:12:03,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:03,498 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken. blk_-2321683491617084038_1189
2013-10-31 16:12:03,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2321683491617084038_1189 src: /127.0.0.1:35016 dest: /127.0.0.1:38271
2013-10-31 16:12:03,501 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2321683491617084038_1189 src: /127.0.0.1:55053 dest: /127.0.0.1:41648
2013-10-31 16:12:03,503 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2321683491617084038_1189 src: /127.0.0.1:48051 dest: /127.0.0.1:47311
2013-10-31 16:12:03,505 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48051, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2321683491617084038_1189, duration: 66329
2013-10-31 16:12:03,506 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2321683491617084038_1189 terminating
2013-10-31 16:12:03,506 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55053, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2321683491617084038_1189, duration: 878457
2013-10-31 16:12:03,507 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2321683491617084038_1189 terminating
2013-10-31 16:12:03,507 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35016, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2321683491617084038_1189, duration: 1971415
2013-10-31 16:12:03,508 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2321683491617084038_1189 size 116
2013-10-31 16:12:03,508 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2321683491617084038_1189 terminating
2013-10-31 16:12:03,510 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2321683491617084038_1189 size 116
2013-10-31 16:12:03,510 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken from client DFSClient_1457307213
2013-10-31 16:12:03,511 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken is closed by DFSClient_1457307213
2013-10-31 16:12:03,511 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2321683491617084038_1189 size 116
2013-10-31 16:12:03,518 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken
2013-10-31 16:12:03,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.splitmetainfo dst=null perm=null
2013-10-31 16:12:03,522 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34950, bytes: 187, op: HDFS_READ, cliID: DFSClient_244823367, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8736535815943837723_1185, duration: 279061
2013-10-31 16:12:03,523 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0017 = 19. Number of splits = 5
2013-10-31 16:12:03,524 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,524 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,524 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,524 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,525 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,526 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0017_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0017 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:12:03,527 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0017 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:12:05,028 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:05,028 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000003_0 not found in cache
2013-10-31 16:12:05,030 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000004_0 not found in cache
2013-10-31 16:12:05,031 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322325030
2013-10-31 16:12:05,094 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0017_m_000006_0' to tip task_20131031160444934_0017_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:05,100 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:12:05,100 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000006_0 which needs 1 slots
2013-10-31 16:12:05,101 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000006_0 which needs 1 slots
2013-10-31 16:12:05,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken dst=null perm=null
2013-10-31 16:12:05,109 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35020, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2321683491617084038_1189, duration: 301155
2013-10-31 16:12:05,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml dst=null perm=null
2013-10-31 16:12:05,120 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35022, bytes: 28513, op: HDFS_READ, cliID: DFSClient_325056449, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-892002836518062520_1186, duration: 387627
2013-10-31 16:12:05,148 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:05,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar dst=null perm=null
2013-10-31 16:12:05,182 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48056, bytes: 239915, op: HDFS_READ, cliID: DFSClient_325056449, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5312415671512961170_1183, duration: 1582669
2013-10-31 16:12:05,276 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0016_m_-768505707
2013-10-31 16:12:05,280 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19128 with signal TERM. Exit code 0
2013-10-31 16:12:05,281 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_1785081909
2013-10-31 16:12:05,281 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_1785081909 spawned.
2013-10-31 16:12:05,282 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000006_0/taskjvm.sh
2013-10-31 16:12:05,538 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_-383608023 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:05,546 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19301 with signal TERM. Exit code 0
2013-10-31 16:12:05,744 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:05,744 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:05,744 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:05,745 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-383608023 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:05,769 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8699900213099915514_1171 file build/test/data/dfs/data/data1/current/blk_-8699900213099915514 for deletion
2013-10-31 16:12:05,769 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8495043711673365996_1173 file build/test/data/dfs/data/data1/current/blk_-8495043711673365996 for deletion
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1537610290047334833_1172 file build/test/data/dfs/data/data2/current/blk_-1537610290047334833 for deletion
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8699900213099915514_1171 at file build/test/data/dfs/data/data1/current/blk_-8699900213099915514
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5829433608470320000_1174 file build/test/data/dfs/data/data2/current/blk_5829433608470320000 for deletion
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8495043711673365996_1173 at file build/test/data/dfs/data/data1/current/blk_-8495043711673365996
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7194689012869079137_1177 file build/test/data/dfs/data/data1/current/blk_7194689012869079137 for deletion
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1537610290047334833_1172 at file build/test/data/dfs/data/data2/current/blk_-1537610290047334833
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7194689012869079137_1177 at file build/test/data/dfs/data/data1/current/blk_7194689012869079137
2013-10-31 16:12:05,770 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5829433608470320000_1174 at file build/test/data/dfs/data/data2/current/blk_5829433608470320000
2013-10-31 16:12:05,803 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0016_m_-768505707
2013-10-31 16:12:06,416 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_-890241865 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:06,426 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19458 with signal TERM. Exit code 0
2013-10-31 16:12:06,595 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:06,595 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:06,595 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:06,595 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-890241865 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:07,091 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:07,091 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000000_0 not found in cache
2013-10-31 16:12:07,092 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322327092
2013-10-31 16:12:07,481 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:07,481 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:07,481 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:07,481 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-768505707 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:07,493 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_2092185245 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:07,498 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19037 with signal TERM. Exit code 0
2013-10-31 16:12:07,655 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:07,655 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:07,655 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:07,655 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_2092185245 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:07,844 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:07,844 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000001_0 not found in cache
2013-10-31 16:12:07,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322327844
2013-10-31 16:12:07,954 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0016
2013-10-31 16:12:07,954 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0016_m_000002_0 not found in cache
2013-10-31 16:12:07,955 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0016 for user-log deletion with retainTimeStamp:1383322327955
2013-10-31 16:12:08,001 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 27
2013-10-31 16:12:08,035 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_-2031316218 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:08,044 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19223 with signal TERM. Exit code 0
2013-10-31 16:12:08,197 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_1785081909 given task: attempt_20131031160444934_0017_m_000006_0
2013-10-31 16:12:08,220 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:08,220 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:08,220 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:08,220 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_-2031316218 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:08,465 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0016_m_1360879598 since job job_20131031160444934_0016 is dead
2013-10-31 16:12:08,469 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19258 with signal TERM. Exit code 0
2013-10-31 16:12:08,628 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:08,628 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:08,628 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:08,628 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0016_m_1360879598 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:08,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:11,638 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000006_0 0.0% setup
2013-10-31 16:12:11,640 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000006_0 is done.
2013-10-31 16:12:11,640 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000006_0 was -1
2013-10-31 16:12:11,641 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:14,108 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000006_0' has completed task_20131031160444934_0017_m_000006 successfully.
2013-10-31 16:12:14,113 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000000_0' to tip task_20131031160444934_0017_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:14,114 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000000
2013-10-31 16:12:14,115 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000001_0' to tip task_20131031160444934_0017_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:14,116 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000001
2013-10-31 16:12:14,118 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:12:14,118 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:12:14,119 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000000_0 which needs 1 slots
2013-10-31 16:12:14,119 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000000_0 which needs 1 slots
2013-10-31 16:12:14,119 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000001_0 which needs 1 slots
2013-10-31 16:12:14,120 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0017_m_000001_0 which needs 1 slots
2013-10-31 16:12:14,161 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_-1672180280
2013-10-31 16:12:14,161 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_-1672180280 spawned.
2013-10-31 16:12:14,162 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0017/attempt_20131031160444934_0017_m_000001_0. Attempting to reuse: jvm_20131031160444934_0017_m_1785081909
2013-10-31 16:12:14,163 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000000_0/taskjvm.sh
2013-10-31 16:12:14,859 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000002_0' to tip task_20131031160444934_0017_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:14,859 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000002
2013-10-31 16:12:14,859 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000003_0' to tip task_20131031160444934_0017_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:14,860 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000003
2013-10-31 16:12:14,862 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:12:14,863 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:12:14,863 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000002_0 which needs 1 slots
2013-10-31 16:12:14,863 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000002_0 which needs 1 slots
2013-10-31 16:12:14,863 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000003_0 which needs 1 slots
2013-10-31 16:12:14,863 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0017_m_000003_0 which needs 1 slots
2013-10-31 16:12:14,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken dst=null perm=null
2013-10-31 16:12:14,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35027, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2321683491617084038_1189, duration: 306896
2013-10-31 16:12:14,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml dst=null perm=null
2013-10-31 16:12:14,875 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48062, bytes: 28513, op: HDFS_READ, cliID: DFSClient_702944806, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 393685
2013-10-31 16:12:14,893 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:14,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar dst=null perm=null
2013-10-31 16:12:14,921 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35030, bytes: 239915, op: HDFS_READ, cliID: DFSClient_702944806, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5312415671512961170_1183, duration: 659251
2013-10-31 16:12:14,965 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0017_m_000004_0' to tip task_20131031160444934_0017_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:14,965 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0017_m_000004
2013-10-31 16:12:14,966 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:12:14,966 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000004_0 which needs 1 slots
2013-10-31 16:12:14,966 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000004_0 which needs 1 slots
2013-10-31 16:12:14,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017/jobToken dst=null perm=null
2013-10-31 16:12:14,973 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48064, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2321683491617084038_1189, duration: 150083
2013-10-31 16:12:14,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.xml dst=null perm=null
2013-10-31 16:12:14,978 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48066, bytes: 28513, op: HDFS_READ, cliID: DFSClient_-223772127, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-892002836518062520_1186, duration: 163742
2013-10-31 16:12:14,986 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_-1717478233
2013-10-31 16:12:14,987 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_-1717478233 spawned.
2013-10-31 16:12:14,987 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_183874956
2013-10-31 16:12:14,988 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_183874956 spawned.
2013-10-31 16:12:14,989 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000003_0/taskjvm.sh
2013-10-31 16:12:14,989 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000002_0/taskjvm.sh
2013-10-31 16:12:14,990 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_-1672180280 given task: attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:15,187 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_1785081909 given task: attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:15,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=null
2013-10-31 16:12:15,306 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48068, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 373288
2013-10-31 16:12:15,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:15,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35036, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 272844
2013-10-31 16:12:15,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:15,424 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:15,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:15,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.jar dst=null perm=null
2013-10-31 16:12:15,439 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35037, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-223772127, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5312415671512961170_1183, duration: 804143
2013-10-31 16:12:15,498 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_794190548
2013-10-31 16:12:15,499 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_794190548 spawned.
2013-10-31 16:12:15,501 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000004_0/taskjvm.sh
2013-10-31 16:12:15,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=null
2013-10-31 16:12:15,775 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48072, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 479601
2013-10-31 16:12:15,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:15,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:15,804 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34971, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 146074
2013-10-31 16:12:15,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:15,813 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001. blk_5772099536953696869_1190
2013-10-31 16:12:15,828 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5772099536953696869_1190 src: /127.0.0.1:55077 dest: /127.0.0.1:41648
2013-10-31 16:12:15,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5772099536953696869_1190 src: /127.0.0.1:48075 dest: /127.0.0.1:47311
2013-10-31 16:12:15,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5772099536953696869_1190 src: /127.0.0.1:34974 dest: /127.0.0.1:50942
2013-10-31 16:12:15,832 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34974, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5772099536953696869_1190, duration: 1310786
2013-10-31 16:12:15,832 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5772099536953696869_1190 terminating
2013-10-31 16:12:15,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:15,832 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48075, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5772099536953696869_1190, duration: 1668707
2013-10-31 16:12:15,832 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5772099536953696869_1190 terminating
2013-10-31 16:12:15,833 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55077, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5772099536953696869_1190, duration: 2143111
2013-10-31 16:12:15,833 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5772099536953696869_1190 terminating
2013-10-31 16:12:15,836 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5772099536953696869_1190 size 8
2013-10-31 16:12:15,836 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:15,836 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:15,836 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5772099536953696869_1190 size 8
2013-10-31 16:12:15,836 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5772099536953696869_1190 size 8
2013-10-31 16:12:16,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:16,092 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:16,092 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000001_0 0.0%
2013-10-31 16:12:16,209 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_-1717478233 given task: attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:16,236 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_183874956 given task: attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:16,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:16,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:16,275 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48079, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 147742
2013-10-31 16:12:16,278 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35047, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 102054
2013-10-31 16:12:16,285 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000. blk_-6404766974028651989_1191
2013-10-31 16:12:16,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6404766974028651989_1191 src: /127.0.0.1:48081 dest: /127.0.0.1:47311
2013-10-31 16:12:16,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6404766974028651989_1191 src: /127.0.0.1:55085 dest: /127.0.0.1:41648
2013-10-31 16:12:16,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6404766974028651989_1191 src: /127.0.0.1:34981 dest: /127.0.0.1:50942
2013-10-31 16:12:16,312 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34981, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6404766974028651989_1191, duration: 1042408
2013-10-31 16:12:16,312 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6404766974028651989_1191 terminating
2013-10-31 16:12:16,312 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6404766974028651989_1191 size 8
2013-10-31 16:12:16,312 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55085, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6404766974028651989_1191, duration: 1606992
2013-10-31 16:12:16,312 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6404766974028651989_1191 terminating
2013-10-31 16:12:16,313 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48081, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6404766974028651989_1191, duration: 2065604
2013-10-31 16:12:16,313 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6404766974028651989_1191 terminating
2013-10-31 16:12:16,314 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:16,314 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:16,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6404766974028651989_1191 size 8
2013-10-31 16:12:16,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6404766974028651989_1191 size 8
2013-10-31 16:12:16,363 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:16,364 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000000_0 0.0%
2013-10-31 16:12:16,635 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_794190548 given task: attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:16,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=null
2013-10-31 16:12:16,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35054, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7955453648049656030_1184, duration: 164435
2013-10-31 16:12:16,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:16,752 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34986, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 134753
2013-10-31 16:12:16,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=null
2013-10-31 16:12:16,762 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48089, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7955453648049656030_1184, duration: 158571
2013-10-31 16:12:16,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:16,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:16,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:16,802 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:34988, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 128203
2013-10-31 16:12:16,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:16,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:16,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:16,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:16,983 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48091, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 138518
2013-10-31 16:12:16,992 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003. blk_-1127580485166157468_1193
2013-10-31 16:12:17,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1127580485166157468_1193 src: /127.0.0.1:55095 dest: /127.0.0.1:41648
2013-10-31 16:12:17,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1127580485166157468_1193 src: /127.0.0.1:34991 dest: /127.0.0.1:50942
2013-10-31 16:12:17,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1127580485166157468_1193 src: /127.0.0.1:35061 dest: /127.0.0.1:38271
2013-10-31 16:12:17,023 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35061, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1127580485166157468_1193, duration: 1112062
2013-10-31 16:12:17,023 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1127580485166157468_1193 terminating
2013-10-31 16:12:17,023 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34991, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1127580485166157468_1193, duration: 1498304
2013-10-31 16:12:17,024 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1127580485166157468_1193 terminating
2013-10-31 16:12:17,024 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55095, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1127580485166157468_1193, duration: 1927846
2013-10-31 16:12:17,024 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1127580485166157468_1193 terminating
2013-10-31 16:12:17,027 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1127580485166157468_1193 size 8
2013-10-31 16:12:17,027 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1127580485166157468_1193 size 8
2013-10-31 16:12:17,028 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1127580485166157468_1193 size 8
2013-10-31 16:12:17,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:17,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:17,067 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48096, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 126447
2013-10-31 16:12:17,076 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002. blk_-2831952084742760834_1193
2013-10-31 16:12:17,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2831952084742760834_1193 src: /127.0.0.1:48097 dest: /127.0.0.1:47311
2013-10-31 16:12:17,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2831952084742760834_1193 src: /127.0.0.1:35065 dest: /127.0.0.1:38271
2013-10-31 16:12:17,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2831952084742760834_1193 src: /127.0.0.1:34997 dest: /127.0.0.1:50942
2013-10-31 16:12:17,105 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:34997, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 1004030
2013-10-31 16:12:17,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2831952084742760834_1193 terminating
2013-10-31 16:12:17,106 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2831952084742760834_1193 size 8
2013-10-31 16:12:17,106 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35065, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2831952084742760834_1193, duration: 1334672
2013-10-31 16:12:17,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2831952084742760834_1193 terminating
2013-10-31 16:12:17,106 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48097, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2831952084742760834_1193, duration: 1812118
2013-10-31 16:12:17,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2831952084742760834_1193 terminating
2013-10-31 16:12:17,107 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:17,107 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:17,109 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2831952084742760834_1193 size 8
2013-10-31 16:12:17,111 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2831952084742760834_1193 size 8
2013-10-31 16:12:17,120 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000000_0
2013-10-31 16:12:17,120 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000001_0
2013-10-31 16:12:17,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017/job.split dst=null perm=null
2013-10-31 16:12:17,136 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35067, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7955453648049656030_1184, duration: 155596
2013-10-31 16:12:17,159 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:17,159 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000002_0 0.0%
2013-10-31 16:12:17,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:17,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48101, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 121534
2013-10-31 16:12:17,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:17,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:17,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0 dst=null perm=null
2013-10-31 16:12:17,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:17,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:17,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000000_0 dst=null perm=null
2013-10-31 16:12:17,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:17,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:17,408 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48102, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 106943
2013-10-31 16:12:17,417 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004. blk_2135090211933811428_1194
2013-10-31 16:12:17,426 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:17,427 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:17,441 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2135090211933811428_1194 src: /127.0.0.1:55106 dest: /127.0.0.1:41648
2013-10-31 16:12:17,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2135090211933811428_1194 src: /127.0.0.1:35002 dest: /127.0.0.1:50942
2013-10-31 16:12:17,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2135090211933811428_1194 src: /127.0.0.1:48105 dest: /127.0.0.1:47311
2013-10-31 16:12:17,447 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48105, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2135090211933811428_1194, duration: 1497655
2013-10-31 16:12:17,447 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2135090211933811428_1194 terminating
2013-10-31 16:12:17,447 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35002, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2135090211933811428_1194, duration: 1850003
2013-10-31 16:12:17,447 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2135090211933811428_1194 terminating
2013-10-31 16:12:17,448 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55106, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0017_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2135090211933811428_1194, duration: 1948958
2013-10-31 16:12:17,448 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2135090211933811428_1194 terminating
2013-10-31 16:12:17,449 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2135090211933811428_1194 size 8
2013-10-31 16:12:17,449 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2135090211933811428_1194 size 8
2013-10-31 16:12:17,450 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2135090211933811428_1194 size 8
2013-10-31 16:12:17,487 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:17,487 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000003_0 0.0%
2013-10-31 16:12:17,850 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:17,850 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:17,868 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000002_0
2013-10-31 16:12:17,868 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000003_0
2013-10-31 16:12:17,919 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0017_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:17,919 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000004_0 0.0%
2013-10-31 16:12:17,969 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0017_m_000004_0
2013-10-31 16:12:18,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0 dst=null perm=null
2013-10-31 16:12:18,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:18,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0 dst=null perm=null
2013-10-31 16:12:18,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:18,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0 dst=null perm=null
2013-10-31 16:12:18,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:18,700 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:12:18,702 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000000_0 is done.
2013-10-31 16:12:18,702 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000000_0 was -1
2013-10-31 16:12:18,702 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:18,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0 dst=null perm=null
2013-10-31 16:12:18,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:19,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:19,119 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0017_m_000006_0
2013-10-31 16:12:19,119 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0017_m_000006_0
2013-10-31 16:12:19,120 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000006_0 not found in cache
2013-10-31 16:12:20,124 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000000_0' has completed task_20131031160444934_0017_m_000000 successfully.
2013-10-31 16:12:20,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:20,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:20,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:20,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000001_0 dst=null perm=null
2013-10-31 16:12:20,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000002_0 dst=null perm=null
2013-10-31 16:12:20,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000003_0 dst=null perm=null
2013-10-31 16:12:20,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary/_attempt_20131031160444934_0017_m_000004_0 dst=null perm=null
2013-10-31 16:12:21,295 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:12:21,297 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:12:21,298 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000001_0 is done.
2013-10-31 16:12:21,298 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000001_0 was -1
2013-10-31 16:12:21,298 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:22,681 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:12:22,683 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:12:22,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000003_0 is done.
2013-10-31 16:12:22,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000003_0 was -1
2013-10-31 16:12:22,684 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:22,736 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:12:22,739 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:12:22,740 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000002_0 is done.
2013-10-31 16:12:22,741 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000002_0 was -1
2013-10-31 16:12:22,741 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:23,115 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:12:23,117 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:12:23,119 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000004_0 is done.
2013-10-31 16:12:23,119 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000004_0 was -1
2013-10-31 16:12:23,119 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:23,130 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000001_0' has completed task_20131031160444934_0017_m_000001 successfully.
2013-10-31 16:12:23,875 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000002_0' has completed task_20131031160444934_0017_m_000002 successfully.
2013-10-31 16:12:23,877 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000003_0' has completed task_20131031160444934_0017_m_000003 successfully.
2013-10-31 16:12:23,976 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000004_0' has completed task_20131031160444934_0017_m_000004 successfully.
2013-10-31 16:12:23,980 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0017_m_000005_0' to tip task_20131031160444934_0017_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:23,982 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0017_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:12:23,983 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0017_m_000005_0 which needs 1 slots
2013-10-31 16:12:23,983 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0017_m_000005_0 which needs 1 slots
2013-10-31 16:12:24,019 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0017_m_1249937429
2013-10-31 16:12:24,020 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0017_m_1249937429 spawned.
2013-10-31 16:12:24,022 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0017/attempt_20131031160444934_0017_m_000005_0/taskjvm.sh
2013-10-31 16:12:24,893 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0017_m_1249937429 given task: attempt_20131031160444934_0017_m_000005_0
2013-10-31 16:12:25,423 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000005_0 0.0%
2013-10-31 16:12:25,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary dst=null perm=null
2013-10-31 16:12:25,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:25,448 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_SUCCESS from client DFSClient_attempt_20131031160444934_0017_m_000005_0
2013-10-31 16:12:25,448 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0017_m_000005_0
2013-10-31 16:12:25,463 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:25,463 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,463 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,464 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5312415671512961170 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,464 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,464 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:25,464 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,464 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7955453648049656030 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,465 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8736535815943837723 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,465 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8736535815943837723 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,465 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8736535815943837723 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,465 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-892002836518062520 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:25,466 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-892002836518062520 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:25,466 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-892002836518062520 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:25,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0017 dst=null perm=null
2013-10-31 16:12:27,246 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:27,246 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_8736535815943837723_1185 blk_-892002836518062520_1186 blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:27,377 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-892002836518062520_1186 file build/test/data/dfs/data/data4/current/blk_-892002836518062520 for deletion
2013-10-31 16:12:27,377 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data3/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:27,377 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-892002836518062520_1186 at file build/test/data/dfs/data/data4/current/blk_-892002836518062520
2013-10-31 16:12:27,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data4/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:27,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data3/current/blk_5312415671512961170
2013-10-31 16:12:27,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data4/current/blk_7955453648049656030
2013-10-31 16:12:27,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8736535815943837723_1185 file build/test/data/dfs/data/data3/current/blk_8736535815943837723 for deletion
2013-10-31 16:12:27,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8736535815943837723_1185 at file build/test/data/dfs/data/data3/current/blk_8736535815943837723
2013-10-31 16:12:27,990 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data6/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:27,990 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data5/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:27,990 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data6/current/blk_5312415671512961170
2013-10-31 16:12:27,991 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data5/current/blk_7955453648049656030
2013-10-31 16:12:28,334 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0017_m_000005_0 0.0% cleanup
2013-10-31 16:12:28,335 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0017_m_000005_0 is done.
2013-10-31 16:12:28,335 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0017_m_000005_0 was -1
2013-10-31 16:12:28,336 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:29,989 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0017_m_000005_0' has completed task_20131031160444934_0017_m_000005 successfully.
2013-10-31 16:12:29,990 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0017 has completed successfully.
2013-10-31 16:12:29,991 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0017,submitTime=1383235923014,launchTime=1383235923527,firstMapTaskLaunchTime=1383235934113,firstJobSetupTaskLaunchTime=1383235925094,firstJobCleanupTaskLaunchTime=1383235943980,finishTime=1383235949990,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[171DBA39EB4D40BF8F96A53B473D2ADE/61C7BBC3CEEB4416B2B8245E31D89539] lower*upper/(1/1) ...fieldedpipesplatform/join
2013-10-31 16:12:29,997 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416. blk_-6815815763095842592_1195
2013-10-31 16:12:30,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6815815763095842592_1195 src: /127.0.0.1:55113 dest: /127.0.0.1:41648
2013-10-31 16:12:30,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6815815763095842592_1195 src: /127.0.0.1:35009 dest: /127.0.0.1:50942
2013-10-31 16:12:30,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6815815763095842592_1195 src: /127.0.0.1:35079 dest: /127.0.0.1:38271
2013-10-31 16:12:30,017 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35079, dest: /127.0.0.1:38271, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6815815763095842592_1195, duration: 3313958
2013-10-31 16:12:30,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6815815763095842592_1195 terminating
2013-10-31 16:12:30,019 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35009, dest: /127.0.0.1:50942, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6815815763095842592_1195, duration: 4210689
2013-10-31 16:12:30,019 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6815815763095842592_1195 terminating
2013-10-31 16:12:30,019 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55113, dest: /127.0.0.1:41648, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_244823367, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6815815763095842592_1195, duration: 5478881
2013-10-31 16:12:30,020 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6815815763095842592_1195 terminating
2013-10-31 16:12:30,021 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6815815763095842592_1195 size 26341
2013-10-31 16:12:30,025 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416 from client DFSClient_244823367
2013-10-31 16:12:30,025 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_logs/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416 is closed by DFSClient_244823367
2013-10-31 16:12:30,026 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6815815763095842592_1195 size 26341
2013-10-31 16:12:30,026 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6815815763095842592_1195 size 26341
2013-10-31 16:12:30,032 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0017_1383235923014_hadoop_%5B171DBA39EB4D40BF8F96A53B473D2ADE%2F61C7BBC3CEEB4416 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:30,033 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000004_0'
2013-10-31 16:12:30,033 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000005_0'
2013-10-31 16:12:30,035 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2321683491617084038 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:30,035 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2321683491617084038 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:30,035 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2321683491617084038 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:30,038 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0017_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:12:30,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0017 dst=null perm=null
2013-10-31 16:12:30,041 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/_temporary
2013-10-31 16:12:30,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=null
2013-10-31 16:12:30,051 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:12:30,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2013-10-31 16:12:30,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2013-10-31 16:12:30,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2013-10-31 16:12:30,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2013-10-31 16:12:30,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2013-10-31 16:12:30,056 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:30,057 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0017 being deleted.
2013-10-31 16:12:30,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2013-10-31 16:12:30,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48114, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6404766974028651989_1191, duration: 289791
2013-10-31 16:12:30,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2013-10-31 16:12:30,061 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48115, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5772099536953696869_1190, duration: 139707
2013-10-31 16:12:30,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2013-10-31 16:12:30,064 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35014, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 271988
2013-10-31 16:12:30,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2013-10-31 16:12:30,065 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35015, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1127580485166157468_1193, duration: 119168
2013-10-31 16:12:30,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2013-10-31 16:12:30,067 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55121, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2135090211933811428_1194, duration: 116541
2013-10-31 16:12:30,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=null
2013-10-31 16:12:30,076 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:12:30,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2013-10-31 16:12:30,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2013-10-31 16:12:30,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2013-10-31 16:12:30,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2013-10-31 16:12:30,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2013-10-31 16:12:30,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2013-10-31 16:12:30,083 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55122, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6404766974028651989_1191, duration: 283185
2013-10-31 16:12:30,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2013-10-31 16:12:30,086 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55123, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5772099536953696869_1190, duration: 268717
2013-10-31 16:12:30,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2013-10-31 16:12:30,088 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35019, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 264754
2013-10-31 16:12:30,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2013-10-31 16:12:30,090 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35089, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1127580485166157468_1193, duration: 268841
2013-10-31 16:12:30,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2013-10-31 16:12:30,093 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35021, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2135090211933811428_1194, duration: 271045
2013-10-31 16:12:30,093 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/join
2013-10-31 16:12:30,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join dst=null perm=null
2013-10-31 16:12:30,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2013-10-31 16:12:30,099 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35022, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6404766974028651989_1191, duration: 268781
2013-10-31 16:12:30,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2013-10-31 16:12:30,102 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55128, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5772099536953696869_1190, duration: 268776
2013-10-31 16:12:30,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2013-10-31 16:12:30,105 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35024, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2831952084742760834_1193, duration: 132146
2013-10-31 16:12:30,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2013-10-31 16:12:30,108 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55130, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1127580485166157468_1193, duration: 116274
2013-10-31 16:12:30,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2013-10-31 16:12:30,111 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55131, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2135090211933811428_1194, duration: 111045
2013-10-31 16:12:30,122 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:12:30,122 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:12:30,141 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] starting
2013-10-31 16:12:30,141 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:12:30,142 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:12:30,142 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:12:30,142 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:12:30,143 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby"]
2013-10-31 16:12:30,143 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] parallel execution is enabled: true
2013-10-31 16:12:30,143 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] starting jobs: 1
2013-10-31 16:12:30,143 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merging] allocating threads: 1
2013-10-31 16:12:30,144 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merging] starting step: (1/1) ...platform/joinsintogroupby
2013-10-31 16:12:30,148 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:12:30,148 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:12:30,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:30,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:12:30,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:30,174 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar. blk_-1059958856430979839_1196
2013-10-31 16:12:30,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:55132 dest: /127.0.0.1:41648
2013-10-31 16:12:30,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:48130 dest: /127.0.0.1:47311
2013-10-31 16:12:30,178 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:35029 dest: /127.0.0.1:50942
2013-10-31 16:12:30,182 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35029, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1059958856430979839_1196, duration: 3352851
2013-10-31 16:12:30,182 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1059958856430979839_1196 terminating
2013-10-31 16:12:30,182 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48130, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1059958856430979839_1196, duration: 2546406
2013-10-31 16:12:30,182 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1059958856430979839_1196 terminating
2013-10-31 16:12:30,182 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55132, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1059958856430979839_1196, duration: 3362030
2013-10-31 16:12:30,183 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1059958856430979839_1196 terminating
2013-10-31 16:12:30,185 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:30,186 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:30,187 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:30,247 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_8736535815943837723_1185 blk_-2321683491617084038_1189 blk_-892002836518062520_1186 blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:30,247 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-2321683491617084038_1189
2013-10-31 16:12:30,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2321683491617084038_1189 file build/test/data/dfs/data/data4/current/blk_-2321683491617084038 for deletion
2013-10-31 16:12:30,378 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2321683491617084038_1189 at file build/test/data/dfs/data/data4/current/blk_-2321683491617084038
2013-10-31 16:12:30,585 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar from client DFSClient_1457307213
2013-10-31 16:12:30,585 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar is closed by DFSClient_1457307213
2013-10-31 16:12:30,593 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar. New replication is 10
2013-10-31 16:12:30,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar dst=null perm=null
2013-10-31 16:12:30,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:30,606 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:12:30,611 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:30,614 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:12:30,617 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:30,620 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:12:30,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:12:31,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,069 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split. New replication is 10
2013-10-31 16:12:31,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=null
2013-10-31 16:12:31,077 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split. blk_7127854054404477716_1197
2013-10-31 16:12:31,078 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:48133 dest: /127.0.0.1:47311
2013-10-31 16:12:31,079 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:55137 dest: /127.0.0.1:41648
2013-10-31 16:12:31,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:35102 dest: /127.0.0.1:38271
2013-10-31 16:12:31,083 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127854054404477716_1197 src: /127.0.0.1:35034 dest: /127.0.0.1:50942
2013-10-31 16:12:31,089 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35034, dest: /127.0.0.1:50942, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127854054404477716_1197, duration: 3583645
2013-10-31 16:12:31,089 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,090 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35102, dest: /127.0.0.1:38271, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127854054404477716_1197, duration: 381167
2013-10-31 16:12:31,090 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,091 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55137, dest: /127.0.0.1:41648, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7127854054404477716_1197, duration: 1189377
2013-10-31 16:12:31,091 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,091 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,091 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48133, dest: /127.0.0.1:47311, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7127854054404477716_1197, duration: 2067294
2013-10-31 16:12:31,092 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7127854054404477716_1197 terminating
2013-10-31 16:12:31,100 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,100 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split from client DFSClient_1457307213
2013-10-31 16:12:31,100 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split is closed by DFSClient_1457307213
2013-10-31 16:12:31,100 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,100 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7127854054404477716_1197 size 2073
2013-10-31 16:12:31,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,119 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo. blk_-2560831434870646292_1198
2013-10-31 16:12:31,120 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2560831434870646292_1198 src: /127.0.0.1:55140 dest: /127.0.0.1:41648
2013-10-31 16:12:31,121 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2560831434870646292_1198 src: /127.0.0.1:48138 dest: /127.0.0.1:47311
2013-10-31 16:12:31,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2560831434870646292_1198 src: /127.0.0.1:35106 dest: /127.0.0.1:38271
2013-10-31 16:12:31,125 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35106, dest: /127.0.0.1:38271, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2560831434870646292_1198, duration: 832245
2013-10-31 16:12:31,125 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2560831434870646292_1198 terminating
2013-10-31 16:12:31,125 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48138, dest: /127.0.0.1:47311, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2560831434870646292_1198, duration: 612954
2013-10-31 16:12:31,125 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2560831434870646292_1198 size 218
2013-10-31 16:12:31,125 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2560831434870646292_1198 terminating
2013-10-31 16:12:31,125 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55140, dest: /127.0.0.1:41648, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2560831434870646292_1198, duration: 983368
2013-10-31 16:12:31,125 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2560831434870646292_1198 size 218
2013-10-31 16:12:31,126 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2560831434870646292_1198 terminating
2013-10-31 16:12:31,127 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2560831434870646292_1198 size 218
2013-10-31 16:12:31,127 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:12:31,127 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:12:31,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,147 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml. blk_3022094558686490251_1199
2013-10-31 16:12:31,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3022094558686490251_1199 src: /127.0.0.1:35038 dest: /127.0.0.1:50942
2013-10-31 16:12:31,152 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3022094558686490251_1199 src: /127.0.0.1:55144 dest: /127.0.0.1:41648
2013-10-31 16:12:31,153 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3022094558686490251_1199 src: /127.0.0.1:35109 dest: /127.0.0.1:38271
2013-10-31 16:12:31,155 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35109, dest: /127.0.0.1:38271, bytes: 29924, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3022094558686490251_1199, duration: 127455
2013-10-31 16:12:31,155 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3022094558686490251_1199 terminating
2013-10-31 16:12:31,155 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3022094558686490251_1199 size 29924
2013-10-31 16:12:31,156 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55144, dest: /127.0.0.1:41648, bytes: 29924, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3022094558686490251_1199, duration: 539060
2013-10-31 16:12:31,156 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3022094558686490251_1199 terminating
2013-10-31 16:12:31,156 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35038, dest: /127.0.0.1:50942, bytes: 29924, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3022094558686490251_1199, duration: 1419247
2013-10-31 16:12:31,157 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3022094558686490251_1199 terminating
2013-10-31 16:12:31,158 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3022094558686490251_1199 size 29924
2013-10-31 16:12:31,159 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml from client DFSClient_1457307213
2013-10-31 16:12:31,159 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml is closed by DFSClient_1457307213
2013-10-31 16:12:31,160 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3022094558686490251_1199 size 29924
2013-10-31 16:12:31,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml dst=null perm=null
2013-10-31 16:12:31,174 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55147, bytes: 30160, op: HDFS_READ, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3022094558686490251_1199, duration: 179181
2013-10-31 16:12:31,196 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0018: nMaps=6 nReduces=1 max=-1
2013-10-31 16:12:31,197 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0018 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:12:31,197 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0018
2013-10-31 16:12:31,197 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0018 RESULT=SUCCESS
2013-10-31 16:12:31,197 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0018
2013-10-31 16:12:31,198 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merging] submitted hadoop job: job_20131031160444934_0018
2013-10-31 16:12:31,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,216 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml. blk_-6606841141478771094_1201
2013-10-31 16:12:31,217 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6606841141478771094_1201 src: /127.0.0.1:35043 dest: /127.0.0.1:50942
2013-10-31 16:12:31,217 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6606841141478771094_1201 src: /127.0.0.1:48146 dest: /127.0.0.1:47311
2013-10-31 16:12:31,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6606841141478771094_1201 src: /127.0.0.1:55150 dest: /127.0.0.1:41648
2013-10-31 16:12:31,221 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55150, dest: /127.0.0.1:41648, bytes: 29989, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6606841141478771094_1201, duration: 85082
2013-10-31 16:12:31,221 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6606841141478771094_1201 terminating
2013-10-31 16:12:31,221 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48146, dest: /127.0.0.1:47311, bytes: 29989, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6606841141478771094_1201, duration: 900038
2013-10-31 16:12:31,222 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6606841141478771094_1201 size 29989
2013-10-31 16:12:31,222 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6606841141478771094_1201 terminating
2013-10-31 16:12:31,222 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35043, dest: /127.0.0.1:50942, bytes: 29989, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6606841141478771094_1201, duration: 1872395
2013-10-31 16:12:31,223 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6606841141478771094_1201 terminating
2013-10-31 16:12:31,224 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml from client DFSClient_-1577091776
2013-10-31 16:12:31,224 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_conf.xml is closed by DFSClient_-1577091776
2013-10-31 16:12:31,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6606841141478771094_1201 size 29989
2013-10-31 16:12:31,226 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6606841141478771094_1201 size 29989
2013-10-31 16:12:31,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:31,234 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken. blk_8179163193991924216_1202
2013-10-31 16:12:31,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8179163193991924216_1202 src: /127.0.0.1:35115 dest: /127.0.0.1:38271
2013-10-31 16:12:31,236 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8179163193991924216_1202 src: /127.0.0.1:55152 dest: /127.0.0.1:41648
2013-10-31 16:12:31,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8179163193991924216_1202 src: /127.0.0.1:48150 dest: /127.0.0.1:47311
2013-10-31 16:12:31,240 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48150, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8179163193991924216_1202, duration: 449258
2013-10-31 16:12:31,241 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8179163193991924216_1202 terminating
2013-10-31 16:12:31,241 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55152, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8179163193991924216_1202, duration: 1238176
2013-10-31 16:12:31,242 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8179163193991924216_1202 terminating
2013-10-31 16:12:31,242 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35115, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8179163193991924216_1202, duration: 2072509
2013-10-31 16:12:31,243 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8179163193991924216_1202 terminating
2013-10-31 16:12:31,245 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8179163193991924216_1202 size 116
2013-10-31 16:12:31,245 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken from client DFSClient_1457307213
2013-10-31 16:12:31,246 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken is closed by DFSClient_1457307213
2013-10-31 16:12:31,246 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8179163193991924216_1202 size 116
2013-10-31 16:12:31,247 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8179163193991924216_1202 size 116
2013-10-31 16:12:31,252 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken
2013-10-31 16:12:31,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.splitmetainfo dst=null perm=null
2013-10-31 16:12:31,256 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48151, bytes: 222, op: HDFS_READ, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2560831434870646292_1198, duration: 271459
2013-10-31 16:12:31,258 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0018 = 71. Number of splits = 6
2013-10-31 16:12:31,258 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,259 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,260 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,261 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,262 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0018_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:12:31,263 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0018 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:12:31,263 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0018 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 16:12:32,144 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0018_m_000007_0' to tip task_20131031160444934_0018_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:32,150 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000000_0'
2013-10-31 16:12:32,150 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000001_0'
2013-10-31 16:12:32,150 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000006_0'
2013-10-31 16:12:32,152 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000007_0 task's state:UNASSIGNED
2013-10-31 16:12:32,152 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000007_0 which needs 1 slots
2013-10-31 16:12:32,152 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000007_0 which needs 1 slots
2013-10-31 16:12:32,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken dst=null perm=null
2013-10-31 16:12:32,160 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48152, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8179163193991924216_1202, duration: 273240
2013-10-31 16:12:32,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml dst=null perm=null
2013-10-31 16:12:32,171 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35052, bytes: 30160, op: HDFS_READ, cliID: DFSClient_531802620, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3022094558686490251_1199, duration: 383154
2013-10-31 16:12:32,203 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:32,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar dst=null perm=null
2013-10-31 16:12:32,231 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48155, bytes: 239915, op: HDFS_READ, cliID: DFSClient_531802620, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1059958856430979839_1196, duration: 1110718
2013-10-31 16:12:32,341 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0017_m_1785081909
2013-10-31 16:12:32,348 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19654 with signal TERM. Exit code 0
2013-10-31 16:12:32,348 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_630055656
2013-10-31 16:12:32,349 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_630055656 spawned.
2013-10-31 16:12:32,351 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000007_0/taskjvm.sh
2013-10-31 16:12:32,779 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2321683491617084038_1189 file build/test/data/dfs/data/data1/current/blk_-2321683491617084038 for deletion
2013-10-31 16:12:32,779 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-892002836518062520_1186 file build/test/data/dfs/data/data2/current/blk_-892002836518062520 for deletion
2013-10-31 16:12:32,779 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2321683491617084038_1189 at file build/test/data/dfs/data/data1/current/blk_-2321683491617084038
2013-10-31 16:12:32,779 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data1/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:32,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-892002836518062520_1186 at file build/test/data/dfs/data/data2/current/blk_-892002836518062520
2013-10-31 16:12:32,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data1/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:32,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data1/current/blk_5312415671512961170
2013-10-31 16:12:32,780 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8736535815943837723_1185 file build/test/data/dfs/data/data2/current/blk_8736535815943837723 for deletion
2013-10-31 16:12:32,781 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data1/current/blk_7955453648049656030
2013-10-31 16:12:32,781 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8736535815943837723_1185 at file build/test/data/dfs/data/data2/current/blk_8736535815943837723
2013-10-31 16:12:32,888 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000002_0'
2013-10-31 16:12:32,888 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0017_m_000003_0'
2013-10-31 16:12:33,203 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:33,203 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:33,203 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:33,203 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_1785081909 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:12:33,248 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-1059958856430979839_1196 to datanode(s) 127.0.0.1:38271
2013-10-31 16:12:33,248 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-2321683491617084038_1189
2013-10-31 16:12:33,249 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_8736535815943837723_1185 blk_-892002836518062520_1186 blk_5312415671512961170_1183 blk_7955453648049656030_1184
2013-10-31 16:12:33,991 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2321683491617084038_1189 file build/test/data/dfs/data/data5/current/blk_-2321683491617084038 for deletion
2013-10-31 16:12:33,992 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2321683491617084038_1189 at file build/test/data/dfs/data/data5/current/blk_-2321683491617084038
2013-10-31 16:12:34,088 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_630055656 given task: attempt_20131031160444934_0018_m_000007_0
2013-10-31 16:12:34,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:35,035 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:35,036 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000005_0 not found in cache
2013-10-31 16:12:35,036 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000004_0 not found in cache
2013-10-31 16:12:35,037 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0017 for user-log deletion with retainTimeStamp:1383322355037
2013-10-31 16:12:35,692 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_794190548 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:35,702 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19950 with signal TERM. Exit code 0
2013-10-31 16:12:35,875 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:35,875 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:35,875 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:35,875 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_794190548 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:35,983 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-1059958856430979839_1196 to 127.0.0.1:38271
2013-10-31 16:12:35,983 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-892002836518062520_1186 file build/test/data/dfs/data/data7/current/blk_-892002836518062520 for deletion
2013-10-31 16:12:35,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5312415671512961170_1183 file build/test/data/dfs/data/data8/current/blk_5312415671512961170 for deletion
2013-10-31 16:12:35,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-892002836518062520_1186 at file build/test/data/dfs/data/data7/current/blk_-892002836518062520
2013-10-31 16:12:35,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7955453648049656030_1184 file build/test/data/dfs/data/data7/current/blk_7955453648049656030 for deletion
2013-10-31 16:12:35,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5312415671512961170_1183 at file build/test/data/dfs/data/data8/current/blk_5312415671512961170
2013-10-31 16:12:35,985 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7955453648049656030_1184 at file build/test/data/dfs/data/data7/current/blk_7955453648049656030
2013-10-31 16:12:35,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1059958856430979839_1196 src: /127.0.0.1:35128 dest: /127.0.0.1:38271
2013-10-31 16:12:35,985 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-1059958856430979839_1196 to /127.0.0.1:38271
2013-10-31 16:12:35,985 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8736535815943837723_1185 file build/test/data/dfs/data/data8/current/blk_8736535815943837723 for deletion
2013-10-31 16:12:35,986 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8736535815943837723_1185 at file build/test/data/dfs/data/data8/current/blk_8736535815943837723
2013-10-31 16:12:35,988 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1059958856430979839_1196 src: /127.0.0.1:35128 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:12:35,990 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1059958856430979839_1196 size 238055
2013-10-31 16:12:36,402 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_1249937429 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:36,412 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20108 with signal TERM. Exit code 0
2013-10-31 16:12:36,575 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:36,575 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:36,575 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:36,575 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_1249937429 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:37,152 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:37,153 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000000_0 not found in cache
2013-10-31 16:12:37,153 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000001_0 not found in cache
2013-10-31 16:12:37,154 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0017 for user-log deletion with retainTimeStamp:1383322357154
2013-10-31 16:12:37,453 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_-1672180280 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:37,462 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19774 with signal TERM. Exit code 0
2013-10-31 16:12:37,515 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000007_0 0.0% setup
2013-10-31 16:12:37,517 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000007_0 is done.
2013-10-31 16:12:37,517 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000007_0 was -1
2013-10-31 16:12:37,518 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:37,889 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0017
2013-10-31 16:12:37,889 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000003_0 not found in cache
2013-10-31 16:12:37,890 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0017_m_000002_0 not found in cache
2013-10-31 16:12:37,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0017 for user-log deletion with retainTimeStamp:1383322357890
2013-10-31 16:12:38,032 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:38,032 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:38,032 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:38,033 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_-1672180280 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:38,158 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000007_0' has completed task_20131031160444934_0018_m_000007 successfully.
2013-10-31 16:12:38,162 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000000_0' to tip task_20131031160444934_0018_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:38,163 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000000
2013-10-31 16:12:38,164 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000001_0' to tip task_20131031160444934_0018_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:38,164 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000001
2013-10-31 16:12:38,166 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:12:38,169 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:12:38,169 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000000_0 which needs 1 slots
2013-10-31 16:12:38,169 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000000_0 which needs 1 slots
2013-10-31 16:12:38,170 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000001_0 which needs 1 slots
2013-10-31 16:12:38,170 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0018_m_000001_0 which needs 1 slots
2013-10-31 16:12:38,206 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_1660329901
2013-10-31 16:12:38,207 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_1660329901 spawned.
2013-10-31 16:12:38,208 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0018/attempt_20131031160444934_0018_m_000000_0. Attempting to reuse: jvm_20131031160444934_0018_m_630055656
2013-10-31 16:12:38,209 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000001_0/taskjvm.sh
2013-10-31 16:12:38,241 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_-1717478233 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:38,251 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19850 with signal TERM. Exit code 0
2013-10-31 16:12:38,304 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0017_m_183874956 since job job_20131031160444934_0017 is dead
2013-10-31 16:12:38,312 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19885 with signal TERM. Exit code 0
2013-10-31 16:12:38,416 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_630055656 given task: attempt_20131031160444934_0018_m_000000_0
2013-10-31 16:12:38,427 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:38,427 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:38,427 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:38,427 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_-1717478233 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:38,452 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:12:38,453 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:12:38,453 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:12:38,453 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0017_m_183874956 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:12:38,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=null
2013-10-31 16:12:38,522 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48163, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7127854054404477716_1197, duration: 172082
2013-10-31 16:12:38,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:12:38,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:12:38,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:12:38,864 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35131, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 133983
2013-10-31 16:12:38,868 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55168, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 129142
2013-10-31 16:12:38,893 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000002_0' to tip task_20131031160444934_0018_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:38,893 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000002
2013-10-31 16:12:38,893 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000003_0' to tip task_20131031160444934_0018_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:12:38,893 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000003
2013-10-31 16:12:38,894 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:12:38,894 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:12:38,895 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000002_0 which needs 1 slots
2013-10-31 16:12:38,895 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000002_0 which needs 1 slots
2013-10-31 16:12:38,895 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000003_0 which needs 1 slots
2013-10-31 16:12:38,895 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0018_m_000003_0 which needs 1 slots
2013-10-31 16:12:38,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken dst=null perm=null
2013-10-31 16:12:38,898 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35133, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8179163193991924216_1202, duration: 144651
2013-10-31 16:12:38,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml dst=null perm=null
2013-10-31 16:12:38,903 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35136, bytes: 30160, op: HDFS_READ, cliID: DFSClient_419271258, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3022094558686490251_1199, duration: 181985
2013-10-31 16:12:38,916 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:38,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar dst=null perm=null
2013-10-31 16:12:38,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35137, bytes: 239915, op: HDFS_READ, cliID: DFSClient_419271258, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1059958856430979839_1196, duration: 714101
2013-10-31 16:12:39,016 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_-844750228
2013-10-31 16:12:39,017 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_-844750228 spawned.
2013-10-31 16:12:39,017 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_965492885
2013-10-31 16:12:39,017 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_965492885 spawned.
2013-10-31 16:12:39,018 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000002_0/taskjvm.sh
2013-10-31 16:12:39,019 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000003_0/taskjvm.sh
2013-10-31 16:12:39,046 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000004_0' to tip task_20131031160444934_0018_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:39,046 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000004
2013-10-31 16:12:39,047 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0018_m_000005_0' to tip task_20131031160444934_0018_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:12:39,047 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0018_m_000005
2013-10-31 16:12:39,048 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:12:39,049 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:12:39,049 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000004_0 which needs 1 slots
2013-10-31 16:12:39,049 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000004_0 which needs 1 slots
2013-10-31 16:12:39,050 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000005_0 which needs 1 slots
2013-10-31 16:12:39,050 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0018_m_000005_0 which needs 1 slots
2013-10-31 16:12:39,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018/jobToken dst=null perm=null
2013-10-31 16:12:39,054 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55174, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8179163193991924216_1202, duration: 141600
2013-10-31 16:12:39,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.xml dst=null perm=null
2013-10-31 16:12:39,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35140, bytes: 30160, op: HDFS_READ, cliID: DFSClient_-2066064743, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3022094558686490251_1199, duration: 167135
2013-10-31 16:12:39,073 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:12:39,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.jar dst=null perm=null
2013-10-31 16:12:39,087 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48174, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2066064743, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1059958856430979839_1196, duration: 687439
2013-10-31 16:12:39,089 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_1660329901 given task: attempt_20131031160444934_0018_m_000001_0
2013-10-31 16:12:39,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=null
2013-10-31 16:12:39,613 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35074, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127854054404477716_1197, duration: 170400
2013-10-31 16:12:39,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:12:39,653 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35075, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 270117
2013-10-31 16:12:39,680 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_-1217636009
2013-10-31 16:12:39,680 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_-1217636009 spawned.
2013-10-31 16:12:39,681 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_m_447578773
2013-10-31 16:12:39,681 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_m_447578773 spawned.
2013-10-31 16:12:39,682 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000005_0/taskjvm.sh
2013-10-31 16:12:39,683 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_m_000004_0/taskjvm.sh
2013-10-31 16:12:39,839 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:12:39,846 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,851 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,857 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:12:39,873 INFO metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:12:40,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:12:40,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:12:40,069 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55181, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1539762991683523844_1085, duration: 140455
2013-10-31 16:12:40,476 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_-844750228 given task: attempt_20131031160444934_0018_m_000002_0
2013-10-31 16:12:40,692 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_-1217636009 given task: attempt_20131031160444934_0018_m_000005_0
2013-10-31 16:12:40,693 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_447578773 given task: attempt_20131031160444934_0018_m_000004_0
2013-10-31 16:12:40,734 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_965492885 given task: attempt_20131031160444934_0018_m_000003_0
2013-10-31 16:12:40,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=null
2013-10-31 16:12:40,989 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35151, bytes: 1577, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127854054404477716_1197, duration: 167575
2013-10-31 16:12:41,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:41,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=null
2013-10-31 16:12:41,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=null
2013-10-31 16:12:41,193 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55191, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7127854054404477716_1197, duration: 161801
2013-10-31 16:12:41,195 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35156, bytes: 545, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000005_0, offset: 1536, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127854054404477716_1197, duration: 260512
2013-10-31 16:12:41,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:41,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018/job.split dst=null perm=null
2013-10-31 16:12:41,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:41,233 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35088, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 175798
2013-10-31 16:12:41,235 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48191, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000005_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 107479
2013-10-31 16:12:41,238 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35090, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127854054404477716_1197, duration: 158359
2013-10-31 16:12:41,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:12:41,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48193, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 133741
2013-10-31 16:12:41,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,317 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48194, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 134506
2013-10-31 16:12:41,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48195, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 110474
2013-10-31 16:12:41,483 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:12:41,484 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000000_0 is done.
2013-10-31 16:12:41,484 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000000_0 was 557
2013-10-31 16:12:41,484 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:41,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,521 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55199, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 138142
2013-10-31 16:12:41,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55200, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000005_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 163243
2013-10-31 16:12:41,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:12:41,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35096, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0018_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 123375
2013-10-31 16:12:42,509 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:12:42,513 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000001_0 is done.
2013-10-31 16:12:42,513 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000001_0 was 528
2013-10-31 16:12:42,513 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:42,942 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8580097153134000137_1001
2013-10-31 16:12:43,169 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0018_m_000007_0
2013-10-31 16:12:43,169 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0018_m_000007_0
2013-10-31 16:12:43,170 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0018_m_000007_0 not found in cache
2013-10-31 16:12:43,918 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+6
2013-10-31 16:12:43,920 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000002_0 is done.
2013-10-31 16:12:43,920 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000002_0 was 64
2013-10-31 16:12:43,920 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:44,121 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000005_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:18+1
2013-10-31 16:12:44,123 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+6
2013-10-31 16:12:44,124 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000005_0 is done.
2013-10-31 16:12:44,124 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000005_0 was 6
2013-10-31 16:12:44,125 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:12:44,125 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000004_0 is done.
2013-10-31 16:12:44,125 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000004_0 was 64
2013-10-31 16:12:44,126 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:44,162 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:6+6
2013-10-31 16:12:44,163 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000003_0 is done.
2013-10-31 16:12:44,163 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000003_0 was 35
2013-10-31 16:12:44,163 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:44,170 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000000_0' has completed task_20131031160444934_0018_m_000000 successfully.
2013-10-31 16:12:44,170 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000001_0' has completed task_20131031160444934_0018_m_000001 successfully.
2013-10-31 16:12:44,171 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0018_r_000000_0' to tip task_20131031160444934_0018_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:44,172 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:12:44,172 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_r_000000_0 which needs 1 slots
2013-10-31 16:12:44,172 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_r_000000_0 which needs 1 slots
2013-10-31 16:12:44,192 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0018_r_-245324502
2013-10-31 16:12:44,193 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0018_r_-245324502 spawned.
2013-10-31 16:12:44,195 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0018/attempt_20131031160444934_0018_r_000000_0/taskjvm.sh
2013-10-31 16:12:44,901 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000002_0' has completed task_20131031160444934_0018_m_000002 successfully.
2013-10-31 16:12:44,902 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000003_0' has completed task_20131031160444934_0018_m_000003 successfully.
2013-10-31 16:12:45,055 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000004_0' has completed task_20131031160444934_0018_m_000004 successfully.
2013-10-31 16:12:45,056 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000005_0' has completed task_20131031160444934_0018_m_000005 successfully.
2013-10-31 16:12:45,251 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_r_-245324502 given task: attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:50,930 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46892, bytes: 557, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000000_0, duration: 10052106
2013-10-31 16:12:50,956 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:46892, bytes: 528, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000001_0, duration: 11769555
2013-10-31 16:12:50,975 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47700, bytes: 64, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000002_0, duration: 13580545
2013-10-31 16:12:50,995 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:47701, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000003_0, duration: 12083574
2013-10-31 16:12:51,013 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58827, bytes: 64, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000004_0, duration: 12669815
2013-10-31 16:12:51,028 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:58827, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0018_m_000005_0, duration: 11623837
2013-10-31 16:12:51,724 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:51,788 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:51,851 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:52,036 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1075 Total time for transactions(ms): 21Number of transactions batched in Syncs: 106 Number of syncs: 765 SyncTimes(ms): 32470 4769
2013-10-31 16:12:52,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:52,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:52,722 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000. blk_2748725046508282754_1203
2013-10-31 16:12:52,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2748725046508282754_1203 src: /127.0.0.1:55208 dest: /127.0.0.1:41648
2013-10-31 16:12:52,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2748725046508282754_1203 src: /127.0.0.1:48206 dest: /127.0.0.1:47311
2013-10-31 16:12:52,766 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2748725046508282754_1203 src: /127.0.0.1:35174 dest: /127.0.0.1:38271
2013-10-31 16:12:52,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35174, dest: /127.0.0.1:38271, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0018_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2748725046508282754_1203, duration: 959690
2013-10-31 16:12:52,768 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2748725046508282754_1203 terminating
2013-10-31 16:12:52,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48206, dest: /127.0.0.1:47311, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0018_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2748725046508282754_1203, duration: 1340515
2013-10-31 16:12:52,770 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2748725046508282754_1203 terminating
2013-10-31 16:12:52,770 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2748725046508282754_1203 size 336
2013-10-31 16:12:52,770 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55208, dest: /127.0.0.1:41648, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0018_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2748725046508282754_1203, duration: 3562147
2013-10-31 16:12:52,771 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2748725046508282754_1203 terminating
2013-10-31 16:12:52,771 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2748725046508282754_1203 size 336
2013-10-31 16:12:52,773 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2748725046508282754_1203 size 336
2013-10-31 16:12:52,773 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:52,773 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:52,810 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0018_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:12:52,811 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:12:53,183 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031160444934_0018_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:12:53,184 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:12:53,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0 dst=null perm=null
2013-10-31 16:12:53,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:12:53,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:53,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary/_attempt_20131031160444934_0018_r_000000_0 dst=null perm=null
2013-10-31 16:12:54,777 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 1.0% reduce > reduce
2013-10-31 16:12:54,780 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_r_000000_0 1.0% reduce > reduce
2013-10-31 16:12:54,781 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_r_000000_0 is done.
2013-10-31 16:12:54,781 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_r_000000_0 was -1
2013-10-31 16:12:54,781 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:12:56,187 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_r_000000_0' has completed task_20131031160444934_0018_r_000000 successfully.
2013-10-31 16:12:56,192 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0018_m_000006_0' to tip task_20131031160444934_0018_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:12:56,195 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0018_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:12:56,195 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0018_m_000006_0 which needs 1 slots
2013-10-31 16:12:56,196 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0018_m_000006_0 which needs 1 slots
2013-10-31 16:12:56,226 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0018/attempt_20131031160444934_0018_m_000006_0. Attempting to reuse: jvm_20131031160444934_0018_m_630055656
2013-10-31 16:12:57,017 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0018_m_630055656 given task: attempt_20131031160444934_0018_m_000006_0
2013-10-31 16:12:57,120 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000006_0 0.0%
2013-10-31 16:12:57,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary dst=null perm=null
2013-10-31 16:12:57,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:12:57,135 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS from client DFSClient_attempt_20131031160444934_0018_m_000006_0
2013-10-31 16:12:57,135 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0018_m_000006_0
2013-10-31 16:12:57,141 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,142 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:57,142 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:57,142 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1059958856430979839 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,142 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:57,143 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,143 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,143 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7127854054404477716 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:57,143 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2560831434870646292 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,144 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2560831434870646292 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:12:57,144 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2560831434870646292 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,144 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3022094558686490251 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:12:57,144 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3022094558686490251 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:12:57,144 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3022094558686490251 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:12:57,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0018 dst=null perm=null
2013-10-31 16:12:57,253 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_7127854054404477716_1197 blk_-2560831434870646292_1198 blk_-1059958856430979839_1196 blk_3022094558686490251_1199
2013-10-31 16:12:57,253 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_7127854054404477716_1197 blk_-2560831434870646292_1198 blk_-1059958856430979839_1196
2013-10-31 16:12:57,387 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2560831434870646292_1198 file build/test/data/dfs/data/data3/current/blk_-2560831434870646292 for deletion
2013-10-31 16:12:57,387 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data3/current/blk_-1059958856430979839 for deletion
2013-10-31 16:12:57,387 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2560831434870646292_1198 at file build/test/data/dfs/data/data3/current/blk_-2560831434870646292
2013-10-31 16:12:57,387 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data4/current/blk_7127854054404477716 for deletion
2013-10-31 16:12:57,388 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data3/current/blk_-1059958856430979839
2013-10-31 16:12:57,388 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data4/current/blk_7127854054404477716
2013-10-31 16:12:59,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2560831434870646292_1198 file build/test/data/dfs/data/data2/current/blk_-2560831434870646292 for deletion
2013-10-31 16:12:59,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data1/current/blk_-1059958856430979839 for deletion
2013-10-31 16:12:59,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2560831434870646292_1198 at file build/test/data/dfs/data/data2/current/blk_-2560831434870646292
2013-10-31 16:12:59,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3022094558686490251_1199 file build/test/data/dfs/data/data1/current/blk_3022094558686490251 for deletion
2013-10-31 16:12:59,789 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data1/current/blk_-1059958856430979839
2013-10-31 16:12:59,789 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data1/current/blk_7127854054404477716 for deletion
2013-10-31 16:12:59,789 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3022094558686490251_1199 at file build/test/data/dfs/data/data1/current/blk_3022094558686490251
2013-10-31 16:12:59,789 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data1/current/blk_7127854054404477716
2013-10-31 16:13:00,093 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0018_m_000006_0 0.0% cleanup
2013-10-31 16:13:00,095 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0018_m_000006_0 is done.
2013-10-31 16:13:00,095 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0018_m_000006_0 was -1
2013-10-31 16:13:00,096 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:00,253 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_7127854054404477716_1197 blk_-2560831434870646292_1198 blk_-1059958856430979839_1196 blk_3022094558686490251_1199
2013-10-31 16:13:00,254 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_7127854054404477716_1197 blk_-1059958856430979839_1196 blk_3022094558686490251_1199
2013-10-31 16:13:01,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2560831434870646292_1198 file build/test/data/dfs/data/data5/current/blk_-2560831434870646292 for deletion
2013-10-31 16:13:01,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data5/current/blk_-1059958856430979839 for deletion
2013-10-31 16:13:01,002 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2560831434870646292_1198 at file build/test/data/dfs/data/data5/current/blk_-2560831434870646292
2013-10-31 16:13:01,002 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3022094558686490251_1199 file build/test/data/dfs/data/data6/current/blk_3022094558686490251 for deletion
2013-10-31 16:13:01,003 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data5/current/blk_-1059958856430979839
2013-10-31 16:13:01,003 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3022094558686490251_1199 at file build/test/data/dfs/data/data6/current/blk_3022094558686490251
2013-10-31 16:13:01,003 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data6/current/blk_7127854054404477716 for deletion
2013-10-31 16:13:01,004 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data6/current/blk_7127854054404477716
2013-10-31 16:13:01,195 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:13:01,196 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0018_r_000000_0
2013-10-31 16:13:02,203 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0018_m_000006_0' has completed task_20131031160444934_0018_m_000006 successfully.
2013-10-31 16:13:02,204 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0018 has completed successfully.
2013-10-31 16:13:02,205 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0018,submitTime=1383235951164,launchTime=1383235951263,firstMapTaskLaunchTime=1383235958162,firstReduceTaskLaunchTime=1383235964171,firstJobSetupTaskLaunchTime=1383235952143,firstJobCleanupTaskLaunchTime=1383235976192,finishTime=1383235982204,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=35,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[2661D9EFBCFC4D2584DAE2E7CA0A0B8B/B99E6D0C38F347C7BE0E1DD6FC639A83] merging/(1/1) ...platform/joinsintogroupby
2013-10-31 16:13:02,212 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7. blk_7127116701397707812_1204
2013-10-31 16:13:02,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127116701397707812_1204 src: /127.0.0.1:35110 dest: /127.0.0.1:50942
2013-10-31 16:13:02,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127116701397707812_1204 src: /127.0.0.1:35180 dest: /127.0.0.1:38271
2013-10-31 16:13:02,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7127116701397707812_1204 src: /127.0.0.1:48214 dest: /127.0.0.1:47311
2013-10-31 16:13:02,223 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48214, dest: /127.0.0.1:47311, bytes: 35429, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7127116701397707812_1204, duration: 487788
2013-10-31 16:13:02,223 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7127116701397707812_1204 terminating
2013-10-31 16:13:02,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35180, dest: /127.0.0.1:38271, bytes: 35429, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7127116701397707812_1204, duration: 1278813
2013-10-31 16:13:02,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7127116701397707812_1204 terminating
2013-10-31 16:13:02,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35110, dest: /127.0.0.1:50942, bytes: 35429, op: HDFS_WRITE, cliID: DFSClient_-1577091776, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7127116701397707812_1204, duration: 2132962
2013-10-31 16:13:02,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7127116701397707812_1204 terminating
2013-10-31 16:13:02,230 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7127116701397707812_1204 size 35429
2013-10-31 16:13:02,231 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7 from client DFSClient_-1577091776
2013-10-31 16:13:02,233 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_logs/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7 is closed by DFSClient_-1577091776
2013-10-31 16:13:02,233 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7127116701397707812_1204 size 35429
2013-10-31 16:13:02,234 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7127116701397707812_1204 size 35429
2013-10-31 16:13:02,239 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0018_1383235951164_hadoop_%5B2661D9EFBCFC4D2584DAE2E7CA0A0B8B%2FB99E6D0C38F347C7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:02,240 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000000_0'
2013-10-31 16:13:02,240 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000001_0'
2013-10-31 16:13:02,240 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000006_0'
2013-10-31 16:13:02,241 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000007_0'
2013-10-31 16:13:02,242 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8179163193991924216 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:02,242 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_r_000000_0'
2013-10-31 16:13:02,242 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8179163193991924216 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:02,242 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8179163193991924216 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:02,245 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0018_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:02,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0018 dst=null perm=null
2013-10-31 16:13:02,249 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/_temporary
2013-10-31 16:13:02,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2013-10-31 16:13:02,269 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:02,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2013-10-31 16:13:02,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2013-10-31 16:13:02,274 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48216, bytes: 340, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2748725046508282754_1203, duration: 283325
2013-10-31 16:13:02,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2013-10-31 16:13:02,294 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:02,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2013-10-31 16:13:02,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2013-10-31 16:13:02,298 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35184, bytes: 340, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2748725046508282754_1203, duration: 282773
2013-10-31 16:13:02,299 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintogroupby
2013-10-31 16:13:02,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2013-10-31 16:13:02,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2013-10-31 16:13:02,305 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35185, bytes: 340, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2748725046508282754_1203, duration: 268824
2013-10-31 16:13:02,313 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:13:02,314 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:13:02,325 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:13:02,325 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:02,325 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:13:02,326 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown"]
2013-10-31 16:13:02,326 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:13:02,326 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:13:02,327 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:13:02,328 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...ldedpipesplatform/unknown
2013-10-31 16:13:02,333 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:13:02,334 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:13:02,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:02,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:13:02,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,357 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar. blk_-2795355961709381774_1205
2013-10-31 16:13:02,359 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:35186 dest: /127.0.0.1:38271
2013-10-31 16:13:02,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:48220 dest: /127.0.0.1:47311
2013-10-31 16:13:02,362 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:55224 dest: /127.0.0.1:41648
2013-10-31 16:13:02,373 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55224, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2795355961709381774_1205, duration: 7588631
2013-10-31 16:13:02,374 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2795355961709381774_1205 terminating
2013-10-31 16:13:02,374 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48220, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2795355961709381774_1205, duration: 8461389
2013-10-31 16:13:02,375 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2795355961709381774_1205 terminating
2013-10-31 16:13:02,375 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35186, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2795355961709381774_1205, duration: 9441779
2013-10-31 16:13:02,376 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2795355961709381774_1205 terminating
2013-10-31 16:13:02,378 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:02,379 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar from client DFSClient_1457307213
2013-10-31 16:13:02,379 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar is closed by DFSClient_1457307213
2013-10-31 16:13:02,380 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:02,380 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:02,387 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar. New replication is 10
2013-10-31 16:13:02,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar dst=null perm=null
2013-10-31 16:13:02,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,403 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:13:02,407 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:02,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:02,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:02,428 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split. New replication is 10
2013-10-31 16:13:02,924 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000002_0'
2013-10-31 16:13:02,924 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000003_0'
2013-10-31 16:13:02,992 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1059958856430979839_1196 file build/test/data/dfs/data/data7/current/blk_-1059958856430979839 for deletion
2013-10-31 16:13:02,992 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3022094558686490251_1199 file build/test/data/dfs/data/data7/current/blk_3022094558686490251 for deletion
2013-10-31 16:13:02,992 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1059958856430979839_1196 at file build/test/data/dfs/data/data7/current/blk_-1059958856430979839
2013-10-31 16:13:02,992 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7127854054404477716_1197 file build/test/data/dfs/data/data8/current/blk_7127854054404477716 for deletion
2013-10-31 16:13:02,993 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3022094558686490251_1199 at file build/test/data/dfs/data/data7/current/blk_3022094558686490251
2013-10-31 16:13:02,993 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7127854054404477716_1197 at file build/test/data/dfs/data/data8/current/blk_7127854054404477716
2013-10-31 16:13:03,076 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000004_0'
2013-10-31 16:13:03,076 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0018_m_000005_0'
2013-10-31 16:13:03,088 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:03,089 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0018 being deleted.
2013-10-31 16:13:03,255 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-2795355961709381774_1205 to datanode(s) 127.0.0.1:50942
2013-10-31 16:13:03,255 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_8179163193991924216_1202
2013-10-31 16:13:03,255 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_8179163193991924216_1202
2013-10-31 16:13:03,389 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-2795355961709381774_1205 to 127.0.0.1:50942
2013-10-31 16:13:03,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8179163193991924216_1202 file build/test/data/dfs/data/data3/current/blk_8179163193991924216 for deletion
2013-10-31 16:13:03,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8179163193991924216_1202 at file build/test/data/dfs/data/data3/current/blk_8179163193991924216
2013-10-31 16:13:03,391 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2795355961709381774_1205 src: /127.0.0.1:35120 dest: /127.0.0.1:50942
2013-10-31 16:13:03,391 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-2795355961709381774_1205 to /127.0.0.1:50942
2013-10-31 16:13:03,394 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2795355961709381774_1205 src: /127.0.0.1:35120 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:13:03,398 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2795355961709381774_1205 size 238055
2013-10-31 16:13:03,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=null
2013-10-31 16:13:03,534 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split. blk_8781975787346649086_1206
2013-10-31 16:13:03,535 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:35121 dest: /127.0.0.1:50942
2013-10-31 16:13:03,537 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:55227 dest: /127.0.0.1:41648
2013-10-31 16:13:03,537 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:35192 dest: /127.0.0.1:38271
2013-10-31 16:13:03,539 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8781975787346649086_1206 src: /127.0.0.1:48226 dest: /127.0.0.1:47311
2013-10-31 16:13:03,542 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48226, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8781975787346649086_1206, duration: 106903
2013-10-31 16:13:03,542 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,543 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35192, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8781975787346649086_1206, duration: 1018794
2013-10-31 16:13:03,543 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,544 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55227, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8781975787346649086_1206, duration: 1962823
2013-10-31 16:13:03,544 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,545 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35121, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8781975787346649086_1206, duration: 2890926
2013-10-31 16:13:03,545 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8781975787346649086_1206 terminating
2013-10-31 16:13:03,546 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,549 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split from client DFSClient_1457307213
2013-10-31 16:13:03,549 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split is closed by DFSClient_1457307213
2013-10-31 16:13:03,550 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,550 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,551 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8781975787346649086_1206 size 1732
2013-10-31 16:13:03,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,570 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo. blk_8067882842254612962_1207
2013-10-31 16:13:03,571 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8067882842254612962_1207 src: /127.0.0.1:35194 dest: /127.0.0.1:38271
2013-10-31 16:13:03,573 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8067882842254612962_1207 src: /127.0.0.1:35126 dest: /127.0.0.1:50942
2013-10-31 16:13:03,574 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8067882842254612962_1207 src: /127.0.0.1:48229 dest: /127.0.0.1:47311
2013-10-31 16:13:03,577 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48229, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8067882842254612962_1207, duration: 64540
2013-10-31 16:13:03,577 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8067882842254612962_1207 terminating
2013-10-31 16:13:03,578 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35126, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8067882842254612962_1207, duration: 835831
2013-10-31 16:13:03,578 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8067882842254612962_1207 terminating
2013-10-31 16:13:03,579 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35194, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8067882842254612962_1207, duration: 1677517
2013-10-31 16:13:03,579 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8067882842254612962_1207 terminating
2013-10-31 16:13:03,581 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8067882842254612962_1207 size 183
2013-10-31 16:13:03,581 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:13:03,582 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:13:03,582 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8067882842254612962_1207 size 183
2013-10-31 16:13:03,583 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8067882842254612962_1207 size 183
2013-10-31 16:13:03,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,607 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml. blk_2067163295264048629_1208
2013-10-31 16:13:03,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2067163295264048629_1208 src: /127.0.0.1:35197 dest: /127.0.0.1:38271
2013-10-31 16:13:03,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2067163295264048629_1208 src: /127.0.0.1:55234 dest: /127.0.0.1:41648
2013-10-31 16:13:03,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2067163295264048629_1208 src: /127.0.0.1:35130 dest: /127.0.0.1:50942
2013-10-31 16:13:03,615 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35130, dest: /127.0.0.1:50942, bytes: 28312, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2067163295264048629_1208, duration: 388357
2013-10-31 16:13:03,615 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2067163295264048629_1208 terminating
2013-10-31 16:13:03,616 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55234, dest: /127.0.0.1:41648, bytes: 28312, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2067163295264048629_1208, duration: 1146700
2013-10-31 16:13:03,616 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2067163295264048629_1208 terminating
2013-10-31 16:13:03,617 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35197, dest: /127.0.0.1:38271, bytes: 28312, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 2070632
2013-10-31 16:13:03,617 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2067163295264048629_1208 terminating
2013-10-31 16:13:03,620 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2067163295264048629_1208 size 28312
2013-10-31 16:13:03,621 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml from client DFSClient_1457307213
2013-10-31 16:13:03,621 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml is closed by DFSClient_1457307213
2013-10-31 16:13:03,621 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2067163295264048629_1208 size 28312
2013-10-31 16:13:03,622 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2067163295264048629_1208 size 28312
2013-10-31 16:13:03,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml dst=null perm=null
2013-10-31 16:13:03,638 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35201, bytes: 28536, op: HDFS_READ, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 416592
2013-10-31 16:13:03,657 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0019: nMaps=5 nReduces=0 max=-1
2013-10-31 16:13:03,658 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0019 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:13:03,658 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0019 RESULT=SUCCESS
2013-10-31 16:13:03,658 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0019
2013-10-31 16:13:03,658 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0019
2013-10-31 16:13:03,660 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0019
2013-10-31 16:13:03,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,693 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml. blk_5577773797244675932_1210
2013-10-31 16:13:03,694 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5577773797244675932_1210 src: /127.0.0.1:48235 dest: /127.0.0.1:47311
2013-10-31 16:13:03,695 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5577773797244675932_1210 src: /127.0.0.1:35134 dest: /127.0.0.1:50942
2013-10-31 16:13:03,696 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5577773797244675932_1210 src: /127.0.0.1:35204 dest: /127.0.0.1:38271
2013-10-31 16:13:03,699 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35204, dest: /127.0.0.1:38271, bytes: 28377, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5577773797244675932_1210, duration: 680608
2013-10-31 16:13:03,699 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5577773797244675932_1210 terminating
2013-10-31 16:13:03,700 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35134, dest: /127.0.0.1:50942, bytes: 28377, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5577773797244675932_1210, duration: 1442267
2013-10-31 16:13:03,700 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5577773797244675932_1210 terminating
2013-10-31 16:13:03,700 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48235, dest: /127.0.0.1:47311, bytes: 28377, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5577773797244675932_1210, duration: 1993037
2013-10-31 16:13:03,701 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5577773797244675932_1210 size 28377
2013-10-31 16:13:03,701 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5577773797244675932_1210 terminating
2013-10-31 16:13:03,704 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5577773797244675932_1210 size 28377
2013-10-31 16:13:03,704 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml from client DFSClient_-1583062373
2013-10-31 16:13:03,704 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_conf.xml is closed by DFSClient_-1583062373
2013-10-31 16:13:03,705 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5577773797244675932_1210 size 28377
2013-10-31 16:13:03,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:03,713 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken. blk_-5892293765468690806_1211
2013-10-31 16:13:03,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5892293765468690806_1211 src: /127.0.0.1:35205 dest: /127.0.0.1:38271
2013-10-31 16:13:03,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5892293765468690806_1211 src: /127.0.0.1:48239 dest: /127.0.0.1:47311
2013-10-31 16:13:03,718 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5892293765468690806_1211 src: /127.0.0.1:35138 dest: /127.0.0.1:50942
2013-10-31 16:13:03,720 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35138, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5892293765468690806_1211, duration: 669669
2013-10-31 16:13:03,720 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5892293765468690806_1211 terminating
2013-10-31 16:13:03,720 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48239, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5892293765468690806_1211, duration: 998294
2013-10-31 16:13:03,720 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5892293765468690806_1211 terminating
2013-10-31 16:13:03,721 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35205, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5892293765468690806_1211, duration: 1059427
2013-10-31 16:13:03,721 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5892293765468690806_1211 terminating
2013-10-31 16:13:03,725 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5892293765468690806_1211 size 116
2013-10-31 16:13:03,725 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken from client DFSClient_1457307213
2013-10-31 16:13:03,725 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken is closed by DFSClient_1457307213
2013-10-31 16:13:03,726 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5892293765468690806_1211 size 116
2013-10-31 16:13:03,726 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5892293765468690806_1211 size 116
2013-10-31 16:13:03,729 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken
2013-10-31 16:13:03,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.splitmetainfo dst=null perm=null
2013-10-31 16:13:03,732 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48241, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8067882842254612962_1207, duration: 126803
2013-10-31 16:13:03,734 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0019 = 19. Number of splits = 5
2013-10-31 16:13:03,734 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,734 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,735 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,736 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,737 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0019_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:03,738 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0019 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:13:03,738 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0019 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:13:04,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8179163193991924216_1202 file build/test/data/dfs/data/data6/current/blk_8179163193991924216 for deletion
2013-10-31 16:13:04,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8179163193991924216_1202 at file build/test/data/dfs/data/data6/current/blk_8179163193991924216
2013-10-31 16:13:05,247 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0019_m_000006_0' to tip task_20131031160444934_0019_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:05,254 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:13:05,254 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000006_0 which needs 1 slots
2013-10-31 16:13:05,255 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000006_0 which needs 1 slots
2013-10-31 16:13:05,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken dst=null perm=null
2013-10-31 16:13:05,261 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48242, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5892293765468690806_1211, duration: 317296
2013-10-31 16:13:05,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml dst=null perm=null
2013-10-31 16:13:05,267 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35211, bytes: 28536, op: HDFS_READ, cliID: DFSClient_-510896954, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 417422
2013-10-31 16:13:05,285 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:05,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar dst=null perm=null
2013-10-31 16:13:05,314 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35212, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-510896954, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2795355961709381774_1205, duration: 1611291
2013-10-31 16:13:05,423 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0018_m_1660329901
2013-10-31 16:13:05,428 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20415 with signal TERM. Exit code 0
2013-10-31 16:13:05,428 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_226989341
2013-10-31 16:13:05,429 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_226989341 spawned.
2013-10-31 16:13:05,437 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000006_0/taskjvm.sh
2013-10-31 16:13:05,521 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:05,521 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:05,521 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:05,523 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_1660329901 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:06,256 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_8179163193991924216_1202
2013-10-31 16:13:06,886 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_226989341 given task: attempt_20131031160444934_0019_m_000006_0
2013-10-31 16:13:07,243 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:07,243 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0018_m_000006_0 not found in cache
2013-10-31 16:13:07,244 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0018 for user-log deletion with retainTimeStamp:1383322387243
2013-10-31 16:13:07,320 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_r_-245324502 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:07,329 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20801 with signal TERM. Exit code 0
2013-10-31 16:13:07,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:07,495 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:07,495 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:07,496 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:07,496 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_r_-245324502 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:07,925 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:07,926 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0018 for user-log deletion with retainTimeStamp:1383322387926
2013-10-31 16:13:08,077 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0018
2013-10-31 16:13:08,079 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0018 for user-log deletion with retainTimeStamp:1383322388079
2013-10-31 16:13:08,133 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_630055656 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,141 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20285 with signal TERM. Exit code 0
2013-10-31 16:13:08,324 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,324 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,324 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:08,325 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_630055656 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:13:08,496 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_-844750228 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,506 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20536 with signal TERM. Exit code 0
2013-10-31 16:13:08,690 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_-1217636009 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,700 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20603 with signal TERM. Exit code 0
2013-10-31 16:13:08,707 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_447578773 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,717 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20602 with signal TERM. Exit code 0
2013-10-31 16:13:08,722 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0018_m_965492885 since job job_20131031160444934_0018 is dead
2013-10-31 16:13:08,727 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,727 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,727 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:08,731 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20572 with signal TERM. Exit code 0
2013-10-31 16:13:08,731 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_-844750228 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:08,790 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8179163193991924216_1202 file build/test/data/dfs/data/data2/current/blk_8179163193991924216 for deletion
2013-10-31 16:13:08,791 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8179163193991924216_1202 at file build/test/data/dfs/data/data2/current/blk_8179163193991924216
2013-10-31 16:13:08,921 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,921 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,921 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:08,921 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_-1217636009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:08,924 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,924 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,925 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:08,925 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_447578773 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:08,927 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:08,928 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:08,928 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:08,928 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0018_m_965492885 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:10,299 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000006_0 0.0% setup
2013-10-31 16:13:10,302 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000006_0 is done.
2013-10-31 16:13:10,303 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000006_0 was -1
2013-10-31 16:13:10,303 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:11,259 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000006_0' has completed task_20131031160444934_0019_m_000006 successfully.
2013-10-31 16:13:11,263 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000000_0' to tip task_20131031160444934_0019_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:11,264 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000000
2013-10-31 16:13:11,265 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000001_0' to tip task_20131031160444934_0019_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:11,265 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000001
2013-10-31 16:13:11,267 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:13:11,268 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:13:11,268 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000000_0 which needs 1 slots
2013-10-31 16:13:11,268 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000000_0 which needs 1 slots
2013-10-31 16:13:11,269 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000001_0 which needs 1 slots
2013-10-31 16:13:11,269 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0019_m_000001_0 which needs 1 slots
2013-10-31 16:13:11,306 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_-1462732907
2013-10-31 16:13:11,307 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_-1462732907 spawned.
2013-10-31 16:13:11,307 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0019/attempt_20131031160444934_0019_m_000000_0. Attempting to reuse: jvm_20131031160444934_0019_m_226989341
2013-10-31 16:13:11,308 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000001_0/taskjvm.sh
2013-10-31 16:13:11,372 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_226989341 given task: attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:11,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=null
2013-10-31 16:13:11,476 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55252, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8781975787346649086_1206, duration: 173766
2013-10-31 16:13:11,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:11,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:11,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:11,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:11,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:11,831 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 135868
2013-10-31 16:13:11,833 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35218, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 101747
2013-10-31 16:13:11,840 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000. blk_-1978869255100246022_1212
2013-10-31 16:13:11,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1978869255100246022_1212 src: /127.0.0.1:55255 dest: /127.0.0.1:41648
2013-10-31 16:13:11,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1978869255100246022_1212 src: /127.0.0.1:35151 dest: /127.0.0.1:50942
2013-10-31 16:13:11,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1978869255100246022_1212 src: /127.0.0.1:35221 dest: /127.0.0.1:38271
2013-10-31 16:13:11,860 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35221, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1978869255100246022_1212, duration: 1280587
2013-10-31 16:13:11,860 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1978869255100246022_1212 terminating
2013-10-31 16:13:11,860 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35151, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1978869255100246022_1212, duration: 1725048
2013-10-31 16:13:11,860 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1978869255100246022_1212 terminating
2013-10-31 16:13:11,861 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55255, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1978869255100246022_1212, duration: 2112135
2013-10-31 16:13:11,861 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1978869255100246022_1212 terminating
2013-10-31 16:13:11,861 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1978869255100246022_1212 size 8
2013-10-31 16:13:11,862 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1978869255100246022_1212 size 8
2013-10-31 16:13:11,863 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:11,863 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:11,863 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1978869255100246022_1212 size 8
2013-10-31 16:13:11,904 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:11,904 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000000_0 0.0%
2013-10-31 16:13:11,934 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000002_0' to tip task_20131031160444934_0019_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:11,934 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000002
2013-10-31 16:13:11,934 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000003_0' to tip task_20131031160444934_0019_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:11,934 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000003
2013-10-31 16:13:11,935 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:13:11,936 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:13:11,936 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000002_0 which needs 1 slots
2013-10-31 16:13:11,936 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000002_0 which needs 1 slots
2013-10-31 16:13:11,936 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000003_0 which needs 1 slots
2013-10-31 16:13:11,936 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0019_m_000003_0 which needs 1 slots
2013-10-31 16:13:11,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken dst=null perm=null
2013-10-31 16:13:11,940 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35222, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5892293765468690806_1211, duration: 131388
2013-10-31 16:13:11,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml dst=null perm=null
2013-10-31 16:13:11,944 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35224, bytes: 28536, op: HDFS_READ, cliID: DFSClient_1810471541, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2067163295264048629_1208, duration: 168343
2013-10-31 16:13:11,957 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:11,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar dst=null perm=null
2013-10-31 16:13:11,971 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55262, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1810471541, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2795355961709381774_1205, duration: 704108
2013-10-31 16:13:12,025 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_235871377
2013-10-31 16:13:12,026 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_235871377 spawned.
2013-10-31 16:13:12,027 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000002_0/taskjvm.sh
2013-10-31 16:13:12,028 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_1122384754
2013-10-31 16:13:12,028 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_1122384754 spawned.
2013-10-31 16:13:12,029 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000003_0/taskjvm.sh
2013-10-31 16:13:12,086 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0019_m_000004_0' to tip task_20131031160444934_0019_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:12,086 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0019_m_000004
2013-10-31 16:13:12,088 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:13:12,088 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000004_0 which needs 1 slots
2013-10-31 16:13:12,088 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000004_0 which needs 1 slots
2013-10-31 16:13:12,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019/jobToken dst=null perm=null
2013-10-31 16:13:12,095 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35227, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5892293765468690806_1211, duration: 300469
2013-10-31 16:13:12,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.xml dst=null perm=null
2013-10-31 16:13:12,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35160, bytes: 28536, op: HDFS_READ, cliID: DFSClient_1753422640, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2067163295264048629_1208, duration: 183142
2013-10-31 16:13:12,125 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:12,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.jar dst=null perm=null
2013-10-31 16:13:12,140 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35161, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1753422640, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2795355961709381774_1205, duration: 643070
2013-10-31 16:13:12,143 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_-1462732907 given task: attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:12,252 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0019_m_-1452522867
2013-10-31 16:13:12,253 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0019_m_-1452522867 spawned.
2013-10-31 16:13:12,254 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0019/attempt_20131031160444934_0019_m_000004_0/taskjvm.sh
2013-10-31 16:13:12,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=null
2013-10-31 16:13:12,721 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35232, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8781975787346649086_1206, duration: 166623
2013-10-31 16:13:12,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:12,761 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35164, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 134941
2013-10-31 16:13:12,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:12,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:12,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:12,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:12,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55271, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 132411
2013-10-31 16:13:13,002 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001. blk_-1793475109059110368_1213
2013-10-31 16:13:13,026 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_235871377 given task: attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:13,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1793475109059110368_1213 src: /127.0.0.1:48269 dest: /127.0.0.1:47311
2013-10-31 16:13:13,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1793475109059110368_1213 src: /127.0.0.1:35168 dest: /127.0.0.1:50942
2013-10-31 16:13:13,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1793475109059110368_1213 src: /127.0.0.1:55274 dest: /127.0.0.1:41648
2013-10-31 16:13:13,039 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55274, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1793475109059110368_1213, duration: 1591364
2013-10-31 16:13:13,039 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1793475109059110368_1213 terminating
2013-10-31 16:13:13,039 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35168, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1793475109059110368_1213, duration: 1929622
2013-10-31 16:13:13,039 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1793475109059110368_1213 terminating
2013-10-31 16:13:13,039 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1793475109059110368_1213 size 8
2013-10-31 16:13:13,040 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48269, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1793475109059110368_1213, duration: 2477158
2013-10-31 16:13:13,040 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1793475109059110368_1213 terminating
2013-10-31 16:13:13,041 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:13,041 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:13,042 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1793475109059110368_1213 size 8
2013-10-31 16:13:13,043 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1793475109059110368_1213 size 8
2013-10-31 16:13:13,107 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:13,107 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000001_0 0.0%
2013-10-31 16:13:13,266 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_1122384754 given task: attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:13,267 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_-1452522867 given task: attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:13,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=null
2013-10-31 16:13:13,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55278, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8781975787346649086_1206, duration: 168496
2013-10-31 16:13:13,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:13,587 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35243, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 140334
2013-10-31 16:13:13,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:13,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:13,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=null
2013-10-31 16:13:13,779 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35177, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8781975787346649086_1206, duration: 247565
2013-10-31 16:13:13,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019/job.split dst=null perm=null
2013-10-31 16:13:13,788 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35247, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8781975787346649086_1206, duration: 145161
2013-10-31 16:13:13,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:13,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:13,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:13,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48281, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 141143
2013-10-31 16:13:13,820 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55285, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 116262
2013-10-31 16:13:13,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:13,829 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 106403
2013-10-31 16:13:13,830 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002. blk_-771868539265426080_1214
2013-10-31 16:13:13,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:13,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:13,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:13,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-771868539265426080_1214 src: /127.0.0.1:35251 dest: /127.0.0.1:38271
2013-10-31 16:13:13,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-771868539265426080_1214 src: /127.0.0.1:35183 dest: /127.0.0.1:50942
2013-10-31 16:13:13,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-771868539265426080_1214 src: /127.0.0.1:48286 dest: /127.0.0.1:47311
2013-10-31 16:13:13,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:13,857 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48286, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-771868539265426080_1214, duration: 1034738
2013-10-31 16:13:13,857 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-771868539265426080_1214 terminating
2013-10-31 16:13:13,858 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35183, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-771868539265426080_1214, duration: 1386086
2013-10-31 16:13:13,858 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-771868539265426080_1214 terminating
2013-10-31 16:13:13,858 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35251, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-771868539265426080_1214, duration: 1787091
2013-10-31 16:13:13,858 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-771868539265426080_1214 terminating
2013-10-31 16:13:13,858 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-771868539265426080_1214 size 8
2013-10-31 16:13:13,859 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-771868539265426080_1214 size 8
2013-10-31 16:13:13,859 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:13,859 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:13,859 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-771868539265426080_1214 size 8
2013-10-31 16:13:13,906 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:13,907 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000002_0 0.0%
2013-10-31 16:13:14,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:14,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:14,066 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55290, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 129634
2013-10-31 16:13:14,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:14,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:14,076 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48288, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 107139
2013-10-31 16:13:14,077 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003. blk_-4539402777667855850_1216
2013-10-31 16:13:14,086 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004. blk_-2121616536547267604_1216
2013-10-31 16:13:14,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4539402777667855850_1216 src: /127.0.0.1:55292 dest: /127.0.0.1:41648
2013-10-31 16:13:14,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4539402777667855850_1216 src: /127.0.0.1:48291 dest: /127.0.0.1:47311
2013-10-31 16:13:14,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4539402777667855850_1216 src: /127.0.0.1:35190 dest: /127.0.0.1:50942
2013-10-31 16:13:14,106 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35190, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 1480854
2013-10-31 16:13:14,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4539402777667855850_1216 terminating
2013-10-31 16:13:14,106 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48291, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4539402777667855850_1216, duration: 1740748
2013-10-31 16:13:14,107 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4539402777667855850_1216 terminating
2013-10-31 16:13:14,107 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55292, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4539402777667855850_1216, duration: 2144940
2013-10-31 16:13:14,107 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4539402777667855850_1216 terminating
2013-10-31 16:13:14,108 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4539402777667855850_1216 size 8
2013-10-31 16:13:14,108 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:14,109 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:14,109 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4539402777667855850_1216 size 8
2013-10-31 16:13:14,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2121616536547267604_1216 src: /127.0.0.1:55293 dest: /127.0.0.1:41648
2013-10-31 16:13:14,110 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4539402777667855850_1216 size 8
2013-10-31 16:13:14,112 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2121616536547267604_1216 src: /127.0.0.1:35191 dest: /127.0.0.1:50942
2013-10-31 16:13:14,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2121616536547267604_1216 src: /127.0.0.1:48294 dest: /127.0.0.1:47311
2013-10-31 16:13:14,115 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48294, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2121616536547267604_1216, duration: 1608122
2013-10-31 16:13:14,115 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2121616536547267604_1216 terminating
2013-10-31 16:13:14,115 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35191, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2121616536547267604_1216, duration: 1579128
2013-10-31 16:13:14,116 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2121616536547267604_1216 size 8
2013-10-31 16:13:14,116 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2121616536547267604_1216 terminating
2013-10-31 16:13:14,116 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55293, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0019_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2121616536547267604_1216, duration: 2395054
2013-10-31 16:13:14,116 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2121616536547267604_1216 terminating
2013-10-31 16:13:14,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2121616536547267604_1216 size 8
2013-10-31 16:13:14,118 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:14,118 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:14,121 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2121616536547267604_1216 size 8
2013-10-31 16:13:14,163 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:14,163 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000003_0 0.0%
2013-10-31 16:13:14,189 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0019_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:14,189 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000004_0 0.0%
2013-10-31 16:13:14,272 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000000_0
2013-10-31 16:13:14,272 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000001_0
2013-10-31 16:13:14,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0 dst=null perm=null
2013-10-31 16:13:14,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:14,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:14,940 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000002_0
2013-10-31 16:13:14,940 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000003_0
2013-10-31 16:13:15,091 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0019_m_000004_0
2013-10-31 16:13:15,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0 dst=null perm=null
2013-10-31 16:13:15,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0 dst=null perm=null
2013-10-31 16:13:15,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0 dst=null perm=null
2013-10-31 16:13:15,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000000_0 dst=null perm=null
2013-10-31 16:13:15,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000004_0 dst=null perm=null
2013-10-31 16:13:15,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000003_0 dst=null perm=null
2013-10-31 16:13:15,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000001_0 dst=null perm=null
2013-10-31 16:13:15,650 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:13:15,651 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000001_0 is done.
2013-10-31 16:13:15,651 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000001_0 was -1
2013-10-31 16:13:15,652 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:15,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0 dst=null perm=null
2013-10-31 16:13:15,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:15,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:15,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary/_attempt_20131031160444934_0019_m_000002_0 dst=null perm=null
2013-10-31 16:13:16,268 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0019_m_000006_0
2013-10-31 16:13:16,269 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0019_m_000006_0
2013-10-31 16:13:16,269 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000006_0 not found in cache
2013-10-31 16:13:16,473 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:13:16,475 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000002_0 is done.
2013-10-31 16:13:16,475 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000002_0 was -1
2013-10-31 16:13:16,475 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:16,702 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:13:16,704 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000004_0 is done.
2013-10-31 16:13:16,704 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000004_0 was -1
2013-10-31 16:13:16,704 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:16,710 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:13:16,711 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000003_0 is done.
2013-10-31 16:13:16,711 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000003_0 was -1
2013-10-31 16:13:16,712 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:17,276 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000001_0' has completed task_20131031160444934_0019_m_000001 successfully.
2013-10-31 16:13:17,481 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:13:17,483 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:13:17,484 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000000_0 is done.
2013-10-31 16:13:17,484 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000000_0 was -1
2013-10-31 16:13:17,484 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:17,944 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000002_0' has completed task_20131031160444934_0019_m_000002 successfully.
2013-10-31 16:13:17,945 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000003_0' has completed task_20131031160444934_0019_m_000003 successfully.
2013-10-31 16:13:18,095 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000004_0' has completed task_20131031160444934_0019_m_000004 successfully.
2013-10-31 16:13:20,281 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000000_0' has completed task_20131031160444934_0019_m_000000 successfully.
2013-10-31 16:13:20,285 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0019_m_000005_0' to tip task_20131031160444934_0019_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:13:20,287 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0019_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:13:20,288 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0019_m_000005_0 which needs 1 slots
2013-10-31 16:13:20,288 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0019_m_000005_0 which needs 1 slots
2013-10-31 16:13:20,322 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0019/attempt_20131031160444934_0019_m_000005_0. Attempting to reuse: jvm_20131031160444934_0019_m_-1462732907
2013-10-31 16:13:20,712 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0019_m_-1462732907 given task: attempt_20131031160444934_0019_m_000005_0
2013-10-31 16:13:20,838 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000005_0 0.0%
2013-10-31 16:13:20,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary dst=null perm=null
2013-10-31 16:13:20,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:20,856 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_SUCCESS from client DFSClient_attempt_20131031160444934_0019_m_000005_0
2013-10-31 16:13:20,857 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0019_m_000005_0
2013-10-31 16:13:20,864 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:20,864 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:20,865 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,865 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2795355961709381774 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,865 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,865 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:20,866 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:20,866 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8781975787346649086 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,866 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8067882842254612962 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:20,866 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8067882842254612962 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,866 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8067882842254612962 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,867 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2067163295264048629 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:20,867 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2067163295264048629 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:20,867 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2067163295264048629 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:20,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0019 dst=null perm=null
2013-10-31 16:13:21,258 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_2067163295264048629_1208 blk_8781975787346649086_1206 blk_-2795355961709381774_1205
2013-10-31 16:13:21,259 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_2067163295264048629_1208 blk_8781975787346649086_1206 blk_-2795355961709381774_1205 blk_8067882842254612962_1207
2013-10-31 16:13:22,008 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data6/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:22,008 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2067163295264048629_1208 file build/test/data/dfs/data/data6/current/blk_2067163295264048629 for deletion
2013-10-31 16:13:22,008 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data5/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:22,009 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data6/current/blk_-2795355961709381774
2013-10-31 16:13:22,009 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data5/current/blk_8781975787346649086
2013-10-31 16:13:22,009 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2067163295264048629_1208 at file build/test/data/dfs/data/data6/current/blk_2067163295264048629
2013-10-31 16:13:23,796 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data2/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:23,796 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2067163295264048629_1208 file build/test/data/dfs/data/data1/current/blk_2067163295264048629 for deletion
2013-10-31 16:13:23,796 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data2/current/blk_-2795355961709381774
2013-10-31 16:13:23,796 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8067882842254612962_1207 file build/test/data/dfs/data/data2/current/blk_8067882842254612962 for deletion
2013-10-31 16:13:23,796 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2067163295264048629_1208 at file build/test/data/dfs/data/data1/current/blk_2067163295264048629
2013-10-31 16:13:23,797 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8067882842254612962_1207 at file build/test/data/dfs/data/data2/current/blk_8067882842254612962
2013-10-31 16:13:23,797 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data1/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:23,798 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data1/current/blk_8781975787346649086
2013-10-31 16:13:23,808 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0019_m_000005_0 0.0% cleanup
2013-10-31 16:13:23,809 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0019_m_000005_0 is done.
2013-10-31 16:13:23,810 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0019_m_000005_0 was -1
2013-10-31 16:13:23,810 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:24,259 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_8781975787346649086_1206 blk_-2795355961709381774_1205 blk_8067882842254612962_1207
2013-10-31 16:13:24,260 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_2067163295264048629_1208 blk_8781975787346649086_1206 blk_-2795355961709381774_1205 blk_8067882842254612962_1207
2013-10-31 16:13:24,396 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data4/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:24,396 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8067882842254612962_1207 file build/test/data/dfs/data/data4/current/blk_8067882842254612962 for deletion
2013-10-31 16:13:24,396 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data4/current/blk_-2795355961709381774
2013-10-31 16:13:24,396 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data3/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:24,397 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8067882842254612962_1207 at file build/test/data/dfs/data/data4/current/blk_8067882842254612962
2013-10-31 16:13:24,397 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data3/current/blk_8781975787346649086
2013-10-31 16:13:26,002 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 47
2013-10-31 16:13:26,294 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0019_m_000005_0' has completed task_20131031160444934_0019_m_000005 successfully.
2013-10-31 16:13:26,295 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0019 has completed successfully.
2013-10-31 16:13:26,296 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0019,submitTime=1383235983628,launchTime=1383235983738,firstMapTaskLaunchTime=1383235991263,firstJobSetupTaskLaunchTime=1383235985247,firstJobCleanupTaskLaunchTime=1383236000285,finishTime=1383236006295,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[8A2953BF1D3A446B80609784D024760C/C501A264995C4077B7A72D7D1F16C4D0] lower*upper/(1/1) ...ldedpipesplatform/unknown
2013-10-31 16:13:26,303 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077. blk_-121103666218840297_1217
2013-10-31 16:13:26,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-121103666218840297_1217 src: /127.0.0.1:35264 dest: /127.0.0.1:38271
2013-10-31 16:13:26,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-121103666218840297_1217 src: /127.0.0.1:55301 dest: /127.0.0.1:41648
2013-10-31 16:13:26,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-121103666218840297_1217 src: /127.0.0.1:48299 dest: /127.0.0.1:47311
2013-10-31 16:13:26,318 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48299, dest: /127.0.0.1:47311, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-121103666218840297_1217, duration: 5092954
2013-10-31 16:13:26,319 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-121103666218840297_1217 terminating
2013-10-31 16:13:26,319 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55301, dest: /127.0.0.1:41648, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-121103666218840297_1217, duration: 3631671
2013-10-31 16:13:26,320 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-121103666218840297_1217 terminating
2013-10-31 16:13:26,320 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-121103666218840297_1217 size 26335
2013-10-31 16:13:26,320 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35264, dest: /127.0.0.1:38271, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-1583062373, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-121103666218840297_1217, duration: 7305510
2013-10-31 16:13:26,321 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-121103666218840297_1217 terminating
2013-10-31 16:13:26,325 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-121103666218840297_1217 size 26335
2013-10-31 16:13:26,325 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077 from client DFSClient_-1583062373
2013-10-31 16:13:26,325 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_logs/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077 is closed by DFSClient_-1583062373
2013-10-31 16:13:26,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-121103666218840297_1217 size 26335
2013-10-31 16:13:26,333 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0019_1383235983628_hadoop_%5B8A2953BF1D3A446B80609784D024760C%2FC501A264995C4077 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:26,334 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000000_0'
2013-10-31 16:13:26,334 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000001_0'
2013-10-31 16:13:26,335 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000005_0'
2013-10-31 16:13:26,335 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000006_0'
2013-10-31 16:13:26,335 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5892293765468690806 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:26,336 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5892293765468690806 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:26,336 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5892293765468690806 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:26,339 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0019_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:26,343 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/_temporary
2013-10-31 16:13:26,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0019 dst=null perm=null
2013-10-31 16:13:26,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=null
2013-10-31 16:13:26,402 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:26,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2013-10-31 16:13:26,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2013-10-31 16:13:26,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2013-10-31 16:13:26,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2013-10-31 16:13:26,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2013-10-31 16:13:26,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2013-10-31 16:13:26,413 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55304, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1978869255100246022_1212, duration: 284672
2013-10-31 16:13:26,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2013-10-31 16:13:26,416 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48302, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1793475109059110368_1213, duration: 256122
2013-10-31 16:13:26,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2013-10-31 16:13:26,419 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35201, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-771868539265426080_1214, duration: 256677
2013-10-31 16:13:26,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2013-10-31 16:13:26,422 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35202, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 257253
2013-10-31 16:13:26,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2013-10-31 16:13:26,425 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35203, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2121616536547267604_1216, duration: 247491
2013-10-31 16:13:26,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=null
2013-10-31 16:13:26,443 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:26,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2013-10-31 16:13:26,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2013-10-31 16:13:26,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2013-10-31 16:13:26,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2013-10-31 16:13:26,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2013-10-31 16:13:26,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2013-10-31 16:13:26,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35204, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1978869255100246022_1212, duration: 282222
2013-10-31 16:13:26,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2013-10-31 16:13:26,456 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48307, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1793475109059110368_1213, duration: 262167
2013-10-31 16:13:26,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2013-10-31 16:13:26,459 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35275, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-771868539265426080_1214, duration: 263150
2013-10-31 16:13:26,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2013-10-31 16:13:26,462 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35207, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 266068
2013-10-31 16:13:26,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2013-10-31 16:13:26,465 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55313, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2121616536547267604_1216, duration: 263850
2013-10-31 16:13:26,465 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/unknown
2013-10-31 16:13:26,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown dst=null perm=null
2013-10-31 16:13:26,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2013-10-31 16:13:26,474 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55314, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1978869255100246022_1212, duration: 258729
2013-10-31 16:13:26,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2013-10-31 16:13:26,478 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35210, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1793475109059110368_1213, duration: 260392
2013-10-31 16:13:26,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2013-10-31 16:13:26,482 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35280, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-771868539265426080_1214, duration: 264513
2013-10-31 16:13:26,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2013-10-31 16:13:26,486 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35212, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4539402777667855850_1216, duration: 261739
2013-10-31 16:13:26,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2013-10-31 16:13:26,490 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48315, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2121616536547267604_1216, duration: 252597
2013-10-31 16:13:26,511 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:13:26,512 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:13:26,534 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] starting
2013-10-31 16:13:26,534 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:26,535 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:13:26,535 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:26,535 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost"]
2013-10-31 16:13:26,536 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] parallel execution is enabled: true
2013-10-31 16:13:26,536 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] starting jobs: 1
2013-10-31 16:13:26,536 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] allocating threads: 1
2013-10-31 16:13:26,538 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (1/1) ...m/joinaroundjoinrightmost
2013-10-31 16:13:26,542 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:13:26,542 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:13:26,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:26,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:13:26,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:26,565 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar. blk_-4227185307943247060_1218
2013-10-31 16:13:26,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:48316 dest: /127.0.0.1:47311
2013-10-31 16:13:26,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:35215 dest: /127.0.0.1:50942
2013-10-31 16:13:26,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:55321 dest: /127.0.0.1:41648
2013-10-31 16:13:26,578 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55321, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4227185307943247060_1218, duration: 4009287
2013-10-31 16:13:26,578 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:26,578 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4227185307943247060_1218 terminating
2013-10-31 16:13:26,579 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35215, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4227185307943247060_1218, duration: 5148434
2013-10-31 16:13:26,579 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4227185307943247060_1218 terminating
2013-10-31 16:13:26,580 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48316, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4227185307943247060_1218, duration: 6068084
2013-10-31 16:13:26,580 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4227185307943247060_1218 terminating
2013-10-31 16:13:26,582 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:26,582 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar from client DFSClient_1457307213
2013-10-31 16:13:26,583 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar is closed by DFSClient_1457307213
2013-10-31 16:13:26,583 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:26,956 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000002_0'
2013-10-31 16:13:26,957 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000003_0'
2013-10-31 16:13:27,000 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2795355961709381774_1205 file build/test/data/dfs/data/data8/current/blk_-2795355961709381774 for deletion
2013-10-31 16:13:27,000 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2067163295264048629_1208 file build/test/data/dfs/data/data7/current/blk_2067163295264048629 for deletion
2013-10-31 16:13:27,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8067882842254612962_1207 file build/test/data/dfs/data/data8/current/blk_8067882842254612962 for deletion
2013-10-31 16:13:27,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2067163295264048629_1208 at file build/test/data/dfs/data/data7/current/blk_2067163295264048629
2013-10-31 16:13:27,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8781975787346649086_1206 file build/test/data/dfs/data/data7/current/blk_8781975787346649086 for deletion
2013-10-31 16:13:27,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2795355961709381774_1205 at file build/test/data/dfs/data/data8/current/blk_-2795355961709381774
2013-10-31 16:13:27,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8781975787346649086_1206 at file build/test/data/dfs/data/data7/current/blk_8781975787346649086
2013-10-31 16:13:27,002 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8067882842254612962_1207 at file build/test/data/dfs/data/data8/current/blk_8067882842254612962
2013-10-31 16:13:27,107 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0019_m_000004_0'
2013-10-31 16:13:27,112 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:27,113 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0019 being deleted.
2013-10-31 16:13:27,260 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-5892293765468690806_1211
2013-10-31 16:13:27,260 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-5892293765468690806_1211
2013-10-31 16:13:27,397 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5892293765468690806_1211 file build/test/data/dfs/data/data4/current/blk_-5892293765468690806 for deletion
2013-10-31 16:13:27,397 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5892293765468690806_1211 at file build/test/data/dfs/data/data4/current/blk_-5892293765468690806
2013-10-31 16:13:27,732 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar. New replication is 10
2013-10-31 16:13:27,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar dst=null perm=null
2013-10-31 16:13:27,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,745 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:13:27,750 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:27,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:27,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,763 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split. New replication is 10
2013-10-31 16:13:27,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=null
2013-10-31 16:13:27,769 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split. blk_-4109011025327673168_1219
2013-10-31 16:13:27,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:35217 dest: /127.0.0.1:50942
2013-10-31 16:13:27,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:55323 dest: /127.0.0.1:41648
2013-10-31 16:13:27,774 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:48321 dest: /127.0.0.1:47311
2013-10-31 16:13:27,776 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4109011025327673168_1219 src: /127.0.0.1:35289 dest: /127.0.0.1:38271
2013-10-31 16:13:27,779 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35289, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 111517
2013-10-31 16:13:27,780 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,780 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48321, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4109011025327673168_1219, duration: 945271
2013-10-31 16:13:27,781 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,781 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,781 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55323, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4109011025327673168_1219, duration: 2067317
2013-10-31 16:13:27,782 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,782 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,783 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35217, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4109011025327673168_1219, duration: 3403927
2013-10-31 16:13:27,783 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-4109011025327673168_1219 terminating
2013-10-31 16:13:27,786 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,786 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split from client DFSClient_1457307213
2013-10-31 16:13:27,787 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split is closed by DFSClient_1457307213
2013-10-31 16:13:27,787 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4109011025327673168_1219 size 1732
2013-10-31 16:13:27,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,807 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo. blk_2391612123643840912_1220
2013-10-31 16:13:27,809 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2391612123643840912_1220 src: /127.0.0.1:55326 dest: /127.0.0.1:41648
2013-10-31 16:13:27,810 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2391612123643840912_1220 src: /127.0.0.1:35291 dest: /127.0.0.1:38271
2013-10-31 16:13:27,812 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2391612123643840912_1220 src: /127.0.0.1:35223 dest: /127.0.0.1:50942
2013-10-31 16:13:27,815 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35223, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2391612123643840912_1220, duration: 67851
2013-10-31 16:13:27,815 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2391612123643840912_1220 terminating
2013-10-31 16:13:27,816 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35291, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2391612123643840912_1220, duration: 953127
2013-10-31 16:13:27,816 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2391612123643840912_1220 terminating
2013-10-31 16:13:27,817 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55326, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2391612123643840912_1220, duration: 1945799
2013-10-31 16:13:27,817 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2391612123643840912_1220 terminating
2013-10-31 16:13:27,818 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2391612123643840912_1220 size 183
2013-10-31 16:13:27,819 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:13:27,820 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:13:27,820 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2391612123643840912_1220 size 183
2013-10-31 16:13:27,820 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2391612123643840912_1220 size 183
2013-10-31 16:13:27,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,846 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml. blk_218933756069317154_1221
2013-10-31 16:13:27,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_218933756069317154_1221 src: /127.0.0.1:48326 dest: /127.0.0.1:47311
2013-10-31 16:13:27,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_218933756069317154_1221 src: /127.0.0.1:35225 dest: /127.0.0.1:50942
2013-10-31 16:13:27,851 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_218933756069317154_1221 src: /127.0.0.1:35295 dest: /127.0.0.1:38271
2013-10-31 16:13:27,854 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35295, dest: /127.0.0.1:38271, bytes: 28680, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_218933756069317154_1221, duration: 60155
2013-10-31 16:13:27,854 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_218933756069317154_1221 terminating
2013-10-31 16:13:27,855 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35225, dest: /127.0.0.1:50942, bytes: 28680, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_218933756069317154_1221, duration: 762755
2013-10-31 16:13:27,855 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_218933756069317154_1221 terminating
2013-10-31 16:13:27,856 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48326, dest: /127.0.0.1:47311, bytes: 28680, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_218933756069317154_1221, duration: 1685916
2013-10-31 16:13:27,856 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_218933756069317154_1221 terminating
2013-10-31 16:13:27,858 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_218933756069317154_1221 size 28680
2013-10-31 16:13:27,858 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_218933756069317154_1221 size 28680
2013-10-31 16:13:27,859 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml from client DFSClient_1457307213
2013-10-31 16:13:27,859 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml is closed by DFSClient_1457307213
2013-10-31 16:13:27,859 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_218933756069317154_1221 size 28680
2013-10-31 16:13:27,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml dst=null perm=null
2013-10-31 16:13:27,873 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35297, bytes: 28908, op: HDFS_READ, cliID: DFSClient_642840985, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_218933756069317154_1221, duration: 400625
2013-10-31 16:13:27,893 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0020: nMaps=5 nReduces=0 max=-1
2013-10-31 16:13:27,893 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0020 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:13:27,893 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0020
2013-10-31 16:13:27,893 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0020 RESULT=SUCCESS
2013-10-31 16:13:27,893 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0020
2013-10-31 16:13:27,895 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0020
2013-10-31 16:13:27,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:27,927 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml. blk_3666268837730504544_1223
2013-10-31 16:13:27,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3666268837730504544_1223 src: /127.0.0.1:35229 dest: /127.0.0.1:50942
2013-10-31 16:13:27,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3666268837730504544_1223 src: /127.0.0.1:48332 dest: /127.0.0.1:47311
2013-10-31 16:13:27,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3666268837730504544_1223 src: /127.0.0.1:55336 dest: /127.0.0.1:41648
2013-10-31 16:13:27,936 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55336, dest: /127.0.0.1:41648, bytes: 28745, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3666268837730504544_1223, duration: 605550
2013-10-31 16:13:27,937 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3666268837730504544_1223 terminating
2013-10-31 16:13:27,937 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48332, dest: /127.0.0.1:47311, bytes: 28745, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3666268837730504544_1223, duration: 1719361
2013-10-31 16:13:27,938 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3666268837730504544_1223 terminating
2013-10-31 16:13:27,938 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3666268837730504544_1223 size 28745
2013-10-31 16:13:27,938 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35229, dest: /127.0.0.1:50942, bytes: 28745, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3666268837730504544_1223, duration: 2265470
2013-10-31 16:13:27,939 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3666268837730504544_1223 terminating
2013-10-31 16:13:27,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3666268837730504544_1223 size 28745
2013-10-31 16:13:27,942 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml from client DFSClient_642840985
2013-10-31 16:13:27,942 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_conf.xml is closed by DFSClient_642840985
2013-10-31 16:13:27,943 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3666268837730504544_1223 size 28745
2013-10-31 16:13:29,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:29,056 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken. blk_295404966245382265_1224
2013-10-31 16:13:29,058 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295404966245382265_1224 src: /127.0.0.1:55337 dest: /127.0.0.1:41648
2013-10-31 16:13:29,059 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295404966245382265_1224 src: /127.0.0.1:35302 dest: /127.0.0.1:38271
2013-10-31 16:13:29,061 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295404966245382265_1224 src: /127.0.0.1:48336 dest: /127.0.0.1:47311
2013-10-31 16:13:29,064 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48336, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_295404966245382265_1224, duration: 65414
2013-10-31 16:13:29,064 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_295404966245382265_1224 terminating
2013-10-31 16:13:29,065 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35302, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_295404966245382265_1224, duration: 825959
2013-10-31 16:13:29,065 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_295404966245382265_1224 terminating
2013-10-31 16:13:29,066 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55337, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_295404966245382265_1224, duration: 1820653
2013-10-31 16:13:29,067 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_295404966245382265_1224 terminating
2013-10-31 16:13:29,069 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_295404966245382265_1224 size 116
2013-10-31 16:13:29,069 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_295404966245382265_1224 size 116
2013-10-31 16:13:29,070 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_295404966245382265_1224 size 116
2013-10-31 16:13:29,469 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken from client DFSClient_1457307213
2013-10-31 16:13:29,470 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken is closed by DFSClient_1457307213
2013-10-31 16:13:29,477 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken
2013-10-31 16:13:29,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.splitmetainfo dst=null perm=null
2013-10-31 16:13:29,481 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35235, bytes: 187, op: HDFS_READ, cliID: DFSClient_642840985, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2391612123643840912_1220, duration: 275092
2013-10-31 16:13:29,482 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0020 = 19. Number of splits = 5
2013-10-31 16:13:29,483 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,483 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,483 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,483 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,484 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,485 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,486 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,486 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0020_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:29,486 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0020 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:13:29,487 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0020 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:13:29,963 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0020_m_000006_0' to tip task_20131031160444934_0020_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:29,973 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:13:29,974 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000006_0 which needs 1 slots
2013-10-31 16:13:29,974 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000006_0 which needs 1 slots
2013-10-31 16:13:29,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken dst=null perm=null
2013-10-31 16:13:29,982 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48338, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_295404966245382265_1224, duration: 304139
2013-10-31 16:13:29,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml dst=null perm=null
2013-10-31 16:13:29,992 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48340, bytes: 28908, op: HDFS_READ, cliID: DFSClient_1413368305, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_218933756069317154_1221, duration: 385962
2013-10-31 16:13:30,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5892293765468690806_1211 file build/test/data/dfs/data/data7/current/blk_-5892293765468690806 for deletion
2013-10-31 16:13:30,001 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5892293765468690806_1211 at file build/test/data/dfs/data/data7/current/blk_-5892293765468690806
2013-10-31 16:13:30,023 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:30,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar dst=null perm=null
2013-10-31 16:13:30,057 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35239, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1413368305, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4227185307943247060_1218, duration: 1060215
2013-10-31 16:13:30,132 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0019_m_1122384754
2013-10-31 16:13:30,136 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21315 with signal TERM. Exit code 0
2013-10-31 16:13:30,136 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_-1766447982
2013-10-31 16:13:30,137 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_-1766447982 spawned.
2013-10-31 16:13:30,138 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000006_0/taskjvm.sh
2013-10-31 16:13:30,204 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:30,204 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:30,204 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:30,204 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_1122384754 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:30,261 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-4227185307943247060_1218 to datanode(s) 127.0.0.1:38271
2013-10-31 16:13:30,261 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5892293765468690806_1211
2013-10-31 16:13:30,398 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-4227185307943247060_1218 to 127.0.0.1:38271
2013-10-31 16:13:30,400 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4227185307943247060_1218 src: /127.0.0.1:35309 dest: /127.0.0.1:38271
2013-10-31 16:13:30,400 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-4227185307943247060_1218 to /127.0.0.1:38271
2013-10-31 16:13:30,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4227185307943247060_1218 src: /127.0.0.1:35309 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:13:30,406 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4227185307943247060_1218 size 238055
2013-10-31 16:13:31,336 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:31,337 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000005_0 not found in cache
2013-10-31 16:13:31,337 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000001_0 not found in cache
2013-10-31 16:13:31,337 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000000_0 not found in cache
2013-10-31 16:13:31,338 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0019 for user-log deletion with retainTimeStamp:1383322411338
2013-10-31 16:13:31,372 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-1766447982 given task: attempt_20131031160444934_0020_m_000006_0
2013-10-31 16:13:31,524 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_226989341 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:31,528 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21023 with signal TERM. Exit code 0
2013-10-31 16:13:31,689 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:31,689 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:31,689 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:31,689 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_226989341 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:13:31,847 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_-1462732907 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:31,851 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21180 with signal TERM. Exit code 0
2013-10-31 16:13:31,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:31,957 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:31,958 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000002_0 not found in cache
2013-10-31 16:13:31,958 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000003_0 not found in cache
2013-10-31 16:13:31,959 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0019 for user-log deletion with retainTimeStamp:1383322411958
2013-10-31 16:13:32,001 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:32,001 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:32,001 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:32,001 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_-1462732907 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:13:32,043 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_235871377 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:32,053 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21277 with signal TERM. Exit code 0
2013-10-31 16:13:32,107 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0019
2013-10-31 16:13:32,108 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0019_m_000004_0 not found in cache
2013-10-31 16:13:32,109 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0019 for user-log deletion with retainTimeStamp:1383322412108
2013-10-31 16:13:32,240 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:32,240 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:32,240 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:32,240 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_235871377 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:32,264 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0019_m_-1452522867 since job job_20131031160444934_0019 is dead
2013-10-31 16:13:32,273 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21314 with signal TERM. Exit code 0
2013-10-31 16:13:32,476 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:32,476 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:32,476 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:32,477 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0019_m_-1452522867 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:32,799 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5892293765468690806_1211 file build/test/data/dfs/data/data1/current/blk_-5892293765468690806 for deletion
2013-10-31 16:13:32,799 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5892293765468690806_1211 at file build/test/data/dfs/data/data1/current/blk_-5892293765468690806
2013-10-31 16:13:34,807 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000006_0 0.0% setup
2013-10-31 16:13:34,810 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000006_0 is done.
2013-10-31 16:13:34,810 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000006_0 was -1
2013-10-31 16:13:34,811 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:35,979 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000006_0' has completed task_20131031160444934_0020_m_000006 successfully.
2013-10-31 16:13:35,984 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000000_0' to tip task_20131031160444934_0020_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:35,987 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000000
2013-10-31 16:13:35,987 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000001_0' to tip task_20131031160444934_0020_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:35,987 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000001
2013-10-31 16:13:35,989 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:13:35,990 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:13:35,991 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000000_0 which needs 1 slots
2013-10-31 16:13:35,991 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000000_0 which needs 1 slots
2013-10-31 16:13:35,991 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000001_0 which needs 1 slots
2013-10-31 16:13:35,992 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0020_m_000001_0 which needs 1 slots
2013-10-31 16:13:36,026 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_1620994915
2013-10-31 16:13:36,027 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_1620994915 spawned.
2013-10-31 16:13:36,028 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0020/attempt_20131031160444934_0020_m_000001_0. Attempting to reuse: jvm_20131031160444934_0020_m_-1766447982
2013-10-31 16:13:36,030 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000000_0/taskjvm.sh
2013-10-31 16:13:36,120 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000002_0' to tip task_20131031160444934_0020_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:36,120 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000002
2013-10-31 16:13:36,120 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000003_0' to tip task_20131031160444934_0020_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:36,121 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000003
2013-10-31 16:13:36,122 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:13:36,122 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:13:36,123 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0020_m_000004_0' to tip task_20131031160444934_0020_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:13:36,123 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000002_0 which needs 1 slots
2013-10-31 16:13:36,123 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0020_m_000004
2013-10-31 16:13:36,123 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000002_0 which needs 1 slots
2013-10-31 16:13:36,124 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000003_0 which needs 1 slots
2013-10-31 16:13:36,124 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:13:36,125 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0020_m_000003_0 which needs 1 slots
2013-10-31 16:13:36,125 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000004_0 which needs 1 slots
2013-10-31 16:13:36,125 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000004_0 which needs 1 slots
2013-10-31 16:13:36,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken dst=null perm=null
2013-10-31 16:13:36,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020/jobToken dst=null perm=null
2013-10-31 16:13:36,131 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55353, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_295404966245382265_1224, duration: 131188
2013-10-31 16:13:36,131 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35316, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_295404966245382265_1224, duration: 303733
2013-10-31 16:13:36,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml dst=null perm=null
2013-10-31 16:13:36,139 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35251, bytes: 28908, op: HDFS_READ, cliID: DFSClient_-853586302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_218933756069317154_1221, duration: 171636
2013-10-31 16:13:36,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.xml dst=null perm=null
2013-10-31 16:13:36,142 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35252, bytes: 28908, op: HDFS_READ, cliID: DFSClient_-736712462, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_218933756069317154_1221, duration: 375260
2013-10-31 16:13:36,157 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:36,165 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:36,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar dst=null perm=null
2013-10-31 16:13:36,172 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35253, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-853586302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4227185307943247060_1218, duration: 660010
2013-10-31 16:13:36,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.jar dst=null perm=null
2013-10-31 16:13:36,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35323, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-736712462, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4227185307943247060_1218, duration: 653575
2013-10-31 16:13:36,228 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_-114402403
2013-10-31 16:13:36,228 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_-114402403 spawned.
2013-10-31 16:13:36,230 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000004_0/taskjvm.sh
2013-10-31 16:13:36,237 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_2133656262
2013-10-31 16:13:36,237 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_2133656262 spawned.
2013-10-31 16:13:36,237 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0020_m_1147863550
2013-10-31 16:13:36,238 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0020_m_1147863550 spawned.
2013-10-31 16:13:36,239 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000003_0/taskjvm.sh
2013-10-31 16:13:36,239 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0020/attempt_20131031160444934_0020_m_000002_0/taskjvm.sh
2013-10-31 16:13:36,368 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-1766447982 given task: attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:36,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=null
2013-10-31 16:13:36,488 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35256, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4109011025327673168_1219, duration: 169849
2013-10-31 16:13:36,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:36,529 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35257, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 118743
2013-10-31 16:13:36,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:36,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:36,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:36,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:36,861 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48361, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 283877
2013-10-31 16:13:36,872 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001. blk_4251397641509719279_1225
2013-10-31 16:13:36,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4251397641509719279_1225 src: /127.0.0.1:35329 dest: /127.0.0.1:38271
2013-10-31 16:13:36,891 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4251397641509719279_1225 src: /127.0.0.1:55366 dest: /127.0.0.1:41648
2013-10-31 16:13:36,892 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4251397641509719279_1225 src: /127.0.0.1:35262 dest: /127.0.0.1:50942
2013-10-31 16:13:36,894 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35262, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4251397641509719279_1225, duration: 1372907
2013-10-31 16:13:36,894 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4251397641509719279_1225 terminating
2013-10-31 16:13:36,894 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55366, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4251397641509719279_1225, duration: 1647295
2013-10-31 16:13:36,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4251397641509719279_1225 terminating
2013-10-31 16:13:36,895 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35329, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4251397641509719279_1225, duration: 2087650
2013-10-31 16:13:36,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4251397641509719279_1225 terminating
2013-10-31 16:13:36,895 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4251397641509719279_1225 size 12
2013-10-31 16:13:36,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4251397641509719279_1225 size 12
2013-10-31 16:13:36,897 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4251397641509719279_1225 size 12
2013-10-31 16:13:36,897 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:36,897 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:36,921 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_1620994915 given task: attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:36,935 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:36,935 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000001_0 0.0%
2013-10-31 16:13:37,386 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-114402403 given task: attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:37,403 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_1147863550 given task: attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:37,415 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_2133656262 given task: attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:37,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=null
2013-10-31 16:13:37,441 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35336, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 167749
2013-10-31 16:13:37,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:37,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:37,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:37,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:37,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55373, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 162860
2013-10-31 16:13:37,730 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48371, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 116619
2013-10-31 16:13:37,739 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000. blk_-4005825571142535716_1226
2013-10-31 16:13:37,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4005825571142535716_1226 src: /127.0.0.1:35339 dest: /127.0.0.1:38271
2013-10-31 16:13:37,774 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4005825571142535716_1226 src: /127.0.0.1:55376 dest: /127.0.0.1:41648
2013-10-31 16:13:37,775 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4005825571142535716_1226 src: /127.0.0.1:35272 dest: /127.0.0.1:50942
2013-10-31 16:13:37,777 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35272, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4005825571142535716_1226, duration: 1224644
2013-10-31 16:13:37,777 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4005825571142535716_1226 terminating
2013-10-31 16:13:37,777 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55376, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4005825571142535716_1226, duration: 1599159
2013-10-31 16:13:37,778 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4005825571142535716_1226 terminating
2013-10-31 16:13:37,778 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35339, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4005825571142535716_1226, duration: 1986038
2013-10-31 16:13:37,778 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4005825571142535716_1226 terminating
2013-10-31 16:13:37,778 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4005825571142535716_1226 size 12
2013-10-31 16:13:37,779 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:37,779 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:37,780 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4005825571142535716_1226 size 12
2013-10-31 16:13:37,780 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4005825571142535716_1226 size 12
2013-10-31 16:13:37,829 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:37,829 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000000_0 0.0%
2013-10-31 16:13:37,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=null
2013-10-31 16:13:37,888 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35345, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 173568
2013-10-31 16:13:37,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=null
2013-10-31 16:13:37,916 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48379, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4109011025327673168_1219, duration: 168259
2013-10-31 16:13:37,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:37,927 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35278, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 105747
2013-10-31 16:13:37,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020/job.split dst=null perm=null
2013-10-31 16:13:37,936 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35348, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4109011025327673168_1219, duration: 145222
2013-10-31 16:13:37,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:37,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:37,956 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35280, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 112586
2013-10-31 16:13:37,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:37,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:37,976 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48383, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 107012
2013-10-31 16:13:37,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:37,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:38,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:38,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:38,164 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48384, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 144682
2013-10-31 16:13:38,175 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004. blk_2906097007668293649_1229
2013-10-31 16:13:38,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:38,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:38,191 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35284, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 188785
2013-10-31 16:13:38,201 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2906097007668293649_1229 src: /127.0.0.1:35352 dest: /127.0.0.1:38271
2013-10-31 16:13:38,202 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002. blk_3264818105380341287_1229
2013-10-31 16:13:38,202 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2906097007668293649_1229 src: /127.0.0.1:35285 dest: /127.0.0.1:50942
2013-10-31 16:13:38,203 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2906097007668293649_1229 src: /127.0.0.1:48389 dest: /127.0.0.1:47311
2013-10-31 16:13:38,206 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48389, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2906097007668293649_1229, duration: 1652633
2013-10-31 16:13:38,206 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2906097007668293649_1229 terminating
2013-10-31 16:13:38,206 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35285, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2906097007668293649_1229, duration: 2039142
2013-10-31 16:13:38,206 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2906097007668293649_1229 terminating
2013-10-31 16:13:38,206 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35352, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2906097007668293649_1229, duration: 2386188
2013-10-31 16:13:38,207 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2906097007668293649_1229 terminating
2013-10-31 16:13:38,209 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2906097007668293649_1229 size 12
2013-10-31 16:13:38,209 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:38,209 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:38,209 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2906097007668293649_1229 size 12
2013-10-31 16:13:38,211 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2906097007668293649_1229 size 12
2013-10-31 16:13:38,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:38,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:13:38,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3264818105380341287_1229 src: /127.0.0.1:35286 dest: /127.0.0.1:50942
2013-10-31 16:13:38,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3264818105380341287_1229 src: /127.0.0.1:35357 dest: /127.0.0.1:38271
2013-10-31 16:13:38,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3264818105380341287_1229 src: /127.0.0.1:55395 dest: /127.0.0.1:41648
2013-10-31 16:13:38,228 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35289, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 120594
2013-10-31 16:13:38,229 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55395, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3264818105380341287_1229, duration: 796905
2013-10-31 16:13:38,230 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3264818105380341287_1229 terminating
2013-10-31 16:13:38,230 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35357, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3264818105380341287_1229, duration: 1156390
2013-10-31 16:13:38,230 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3264818105380341287_1229 terminating
2013-10-31 16:13:38,230 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35286, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3264818105380341287_1229, duration: 1494236
2013-10-31 16:13:38,231 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3264818105380341287_1229 terminating
2013-10-31 16:13:38,232 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3264818105380341287_1229 size 12
2013-10-31 16:13:38,233 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3264818105380341287_1229 size 12
2013-10-31 16:13:38,234 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3264818105380341287_1229 size 12
2013-10-31 16:13:38,632 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:38,633 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:38,740 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003. blk_-1698530720272675639_1229
2013-10-31 16:13:38,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1698530720272675639_1229 src: /127.0.0.1:55396 dest: /127.0.0.1:41648
2013-10-31 16:13:38,798 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1698530720272675639_1229 src: /127.0.0.1:35292 dest: /127.0.0.1:50942
2013-10-31 16:13:38,800 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1698530720272675639_1229 src: /127.0.0.1:35362 dest: /127.0.0.1:38271
2013-10-31 16:13:38,805 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35362, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1698530720272675639_1229, duration: 2311191
2013-10-31 16:13:38,805 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1698530720272675639_1229 terminating
2013-10-31 16:13:38,806 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35292, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1698530720272675639_1229, duration: 3092888
2013-10-31 16:13:38,806 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1698530720272675639_1229 terminating
2013-10-31 16:13:38,806 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1698530720272675639_1229 size 12
2013-10-31 16:13:38,806 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55396, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0020_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1698530720272675639_1229, duration: 3917964
2013-10-31 16:13:38,807 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1698530720272675639_1229 size 12
2013-10-31 16:13:38,807 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1698530720272675639_1229 terminating
2013-10-31 16:13:38,808 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1698530720272675639_1229 size 12
2013-10-31 16:13:38,809 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:38,810 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:38,951 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:38,951 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000004_0 0.0%
2013-10-31 16:13:38,952 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:38,952 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000003_0 0.0%
2013-10-31 16:13:38,952 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0020_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:13:38,952 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000002_0 0.0%
2013-10-31 16:13:38,995 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000000_0
2013-10-31 16:13:38,995 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000001_0
2013-10-31 16:13:39,126 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000002_0
2013-10-31 16:13:39,127 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000003_0
2013-10-31 16:13:39,128 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0020_m_000004_0
2013-10-31 16:13:39,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0 dst=null perm=null
2013-10-31 16:13:39,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,848 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:13:39,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,860 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000000_0 dst=null perm=null
2013-10-31 16:13:39,866 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,871 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,882 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,887 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:13:39,887 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:13:39,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0 dst=null perm=null
2013-10-31 16:13:39,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0 dst=null perm=null
2013-10-31 16:13:39,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0 dst=null perm=null
2013-10-31 16:13:39,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0 dst=null perm=null
2013-10-31 16:13:39,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:39,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000001_0 dst=null perm=null
2013-10-31 16:13:39,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:39,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000004_0 dst=null perm=null
2013-10-31 16:13:39,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000003_0 dst=null perm=null
2013-10-31 16:13:39,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/_attempt_20131031160444934_0020_m_000002_0 dst=null perm=null
2013-10-31 16:13:40,369 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:13:40,371 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000000_0 is done.
2013-10-31 16:13:40,371 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000000_0 was -1
2013-10-31 16:13:40,371 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:40,816 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:13:40,818 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000004_0 is done.
2013-10-31 16:13:40,818 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000004_0 was -1
2013-10-31 16:13:40,818 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:40,843 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:13:40,844 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000002_0 is done.
2013-10-31 16:13:40,844 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000002_0 was -1
2013-10-31 16:13:40,844 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:13:40,848 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:13:40,850 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000003_0 is done.
2013-10-31 16:13:40,850 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000003_0 was -1
2013-10-31 16:13:40,850 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:40,991 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0020_m_000006_0
2013-10-31 16:13:40,991 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0020_m_000006_0
2013-10-31 16:13:40,991 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000006_0 not found in cache
2013-10-31 16:13:41,800 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:13:41,804 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 3ms
2013-10-31 16:13:41,999 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000000_0' has completed task_20131031160444934_0020_m_000000 successfully.
2013-10-31 16:13:42,130 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000002_0' has completed task_20131031160444934_0020_m_000002 successfully.
2013-10-31 16:13:42,132 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000003_0' has completed task_20131031160444934_0020_m_000003 successfully.
2013-10-31 16:13:42,134 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000004_0' has completed task_20131031160444934_0020_m_000004 successfully.
2013-10-31 16:13:42,497 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:13:42,501 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:13:42,502 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000001_0 is done.
2013-10-31 16:13:42,502 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000001_0 was -1
2013-10-31 16:13:42,502 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:44,803 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:13:44,811 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:38271, blocks: 62, processing time: 7 msecs
2013-10-31 16:13:44,812 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 62 blocks took 0 msec to generate and 9 msecs for RPC and NN processing
2013-10-31 16:13:45,005 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000001_0' has completed task_20131031160444934_0020_m_000001 successfully.
2013-10-31 16:13:45,009 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0020_m_000005_0' to tip task_20131031160444934_0020_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:13:45,011 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0020_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:13:45,012 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0020_m_000005_0 which needs 1 slots
2013-10-31 16:13:45,012 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0020_m_000005_0 which needs 1 slots
2013-10-31 16:13:45,046 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0020/attempt_20131031160444934_0020_m_000005_0. Attempting to reuse: jvm_20131031160444934_0020_m_-1766447982
2013-10-31 16:13:46,024 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0020_m_-1766447982 given task: attempt_20131031160444934_0020_m_000005_0
2013-10-31 16:13:46,129 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000005_0 0.0%
2013-10-31 16:13:46,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary dst=null perm=null
2013-10-31 16:13:46,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:46,151 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS from client DFSClient_attempt_20131031160444934_0020_m_000005_0
2013-10-31 16:13:46,151 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0020_m_000005_0
2013-10-31 16:13:46,439 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:46,439 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,439 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:46,439 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4227185307943247060 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,440 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,440 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:46,440 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:46,440 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4109011025327673168 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2391612123643840912 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2391612123643840912 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:46,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2391612123643840912 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_218933756069317154 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:46,441 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_218933756069317154 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:46,442 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_218933756069317154 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:13:46,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0020 dst=null perm=null
2013-10-31 16:13:48,265 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_218933756069317154_1221 blk_2391612123643840912_1220 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:48,265 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_218933756069317154_1221 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:48,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data4/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:48,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data3/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:48,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data4/current/blk_-4227185307943247060
2013-10-31 16:13:48,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data3/current/blk_-4109011025327673168
2013-10-31 16:13:48,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_218933756069317154_1221 file build/test/data/dfs/data/data4/current/blk_218933756069317154 for deletion
2013-10-31 16:13:48,405 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_218933756069317154_1221 at file build/test/data/dfs/data/data4/current/blk_218933756069317154
2013-10-31 16:13:49,103 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0020_m_000005_0 0.0% cleanup
2013-10-31 16:13:49,104 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0020_m_000005_0 is done.
2013-10-31 16:13:49,105 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0020_m_000005_0 was -1
2013-10-31 16:13:49,105 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:13:50,805 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data1/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:50,805 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data1/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_218933756069317154_1221 file build/test/data/dfs/data/data1/current/blk_218933756069317154 for deletion
2013-10-31 16:13:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data1/current/blk_-4227185307943247060
2013-10-31 16:13:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2391612123643840912_1220 file build/test/data/dfs/data/data2/current/blk_2391612123643840912 for deletion
2013-10-31 16:13:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data1/current/blk_-4109011025327673168
2013-10-31 16:13:50,806 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2391612123643840912_1220 at file build/test/data/dfs/data/data2/current/blk_2391612123643840912
2013-10-31 16:13:50,807 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_218933756069317154_1221 at file build/test/data/dfs/data/data1/current/blk_218933756069317154
2013-10-31 16:13:51,020 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0020_m_000005_0' has completed task_20131031160444934_0020_m_000005 successfully.
2013-10-31 16:13:51,021 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0020 has completed successfully.
2013-10-31 16:13:51,021 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0020,submitTime=1383236007864,launchTime=1383236009486,firstMapTaskLaunchTime=1383236015983,firstJobSetupTaskLaunchTime=1383236009963,firstJobCleanupTaskLaunchTime=1383236025008,finishTime=1383236031021,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[BB76075253814B09B178341B955B63E0/7D1347B078E04565AB065F4EA23AF681] lower*upper1*upper2/(1/1) ...m/joinaroundjoinrightmost
2013-10-31 16:13:51,027 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565. blk_-2034678040060553034_1230
2013-10-31 16:13:51,029 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2034678040060553034_1230 src: /127.0.0.1:48398 dest: /127.0.0.1:47311
2013-10-31 16:13:51,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2034678040060553034_1230 src: /127.0.0.1:35366 dest: /127.0.0.1:38271
2013-10-31 16:13:51,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2034678040060553034_1230 src: /127.0.0.1:55403 dest: /127.0.0.1:41648
2013-10-31 16:13:51,039 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55403, dest: /127.0.0.1:41648, bytes: 26363, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2034678040060553034_1230, duration: 1518680
2013-10-31 16:13:51,040 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2034678040060553034_1230 terminating
2013-10-31 16:13:51,040 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35366, dest: /127.0.0.1:38271, bytes: 26363, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2034678040060553034_1230, duration: 3981214
2013-10-31 16:13:51,041 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2034678040060553034_1230 terminating
2013-10-31 16:13:51,041 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48398, dest: /127.0.0.1:47311, bytes: 26363, op: HDFS_WRITE, cliID: DFSClient_642840985, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2034678040060553034_1230, duration: 4938079
2013-10-31 16:13:51,042 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2034678040060553034_1230 terminating
2013-10-31 16:13:51,045 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2034678040060553034_1230 size 26363
2013-10-31 16:13:51,046 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565 from client DFSClient_642840985
2013-10-31 16:13:51,046 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_logs/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565 is closed by DFSClient_642840985
2013-10-31 16:13:51,047 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2034678040060553034_1230 size 26363
2013-10-31 16:13:51,047 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2034678040060553034_1230 size 26363
2013-10-31 16:13:51,055 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0020_1383236007864_hadoop_%5BBB76075253814B09B178341B955B63E0%2F7D1347B078E04565 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:51,056 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000000_0'
2013-10-31 16:13:51,056 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000001_0'
2013-10-31 16:13:51,056 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000005_0'
2013-10-31 16:13:51,056 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000006_0'
2013-10-31 16:13:51,057 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295404966245382265 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:13:51,058 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295404966245382265 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:13:51,058 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295404966245382265 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:13:51,061 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0020_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:13:51,064 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary
2013-10-31 16:13:51,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0020 dst=null perm=null
2013-10-31 16:13:51,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2013-10-31 16:13:51,120 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:51,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2013-10-31 16:13:51,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2013-10-31 16:13:51,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2013-10-31 16:13:51,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2013-10-31 16:13:51,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2013-10-31 16:13:51,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2013-10-31 16:13:51,131 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35300, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4005825571142535716_1226, duration: 329282
2013-10-31 16:13:51,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2013-10-31 16:13:51,134 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35370, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4251397641509719279_1225, duration: 267103
2013-10-31 16:13:51,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2013-10-31 16:13:51,137 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35302, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3264818105380341287_1229, duration: 271243
2013-10-31 16:13:51,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2013-10-31 16:13:51,140 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55408, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1698530720272675639_1229, duration: 267984
2013-10-31 16:13:51,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2013-10-31 16:13:51,143 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000002_0'
2013-10-31 16:13:51,143 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000003_0'
2013-10-31 16:13:51,147 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48406, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2906097007668293649_1229, duration: 1940252
2013-10-31 16:13:51,148 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0020_m_000004_0'
2013-10-31 16:13:51,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2013-10-31 16:13:51,165 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:13:51,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2013-10-31 16:13:51,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2013-10-31 16:13:51,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2013-10-31 16:13:51,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2013-10-31 16:13:51,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2013-10-31 16:13:51,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2013-10-31 16:13:51,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35374, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4005825571142535716_1226, duration: 273009
2013-10-31 16:13:51,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2013-10-31 16:13:51,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35306, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4251397641509719279_1225, duration: 268143
2013-10-31 16:13:51,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2013-10-31 16:13:51,181 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55412, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3264818105380341287_1229, duration: 269148
2013-10-31 16:13:51,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2013-10-31 16:13:51,184 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35308, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1698530720272675639_1229, duration: 267719
2013-10-31 16:13:51,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2013-10-31 16:13:51,188 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48411, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2906097007668293649_1229, duration: 269556
2013-10-31 16:13:51,188 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost
2013-10-31 16:13:51,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2013-10-31 16:13:51,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2013-10-31 16:13:51,196 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35310, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4005825571142535716_1226, duration: 267063
2013-10-31 16:13:51,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2013-10-31 16:13:51,201 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35380, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4251397641509719279_1225, duration: 290268
2013-10-31 16:13:51,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2013-10-31 16:13:51,205 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35312, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3264818105380341287_1229, duration: 257193
2013-10-31 16:13:51,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2013-10-31 16:13:51,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35313, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1698530720272675639_1229, duration: 253326
2013-10-31 16:13:51,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2013-10-31 16:13:51,213 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35383, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2906097007668293649_1229, duration: 254333
2013-10-31 16:13:51,236 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:13:51,236 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:13:51,266 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_295404966245382265_1224 blk_2391612123643840912_1220 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:51,267 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:13:51,267 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_218933756069317154_1221 blk_2391612123643840912_1220 blk_-4109011025327673168_1219 blk_-4227185307943247060_1218
2013-10-31 16:13:51,269 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:13:51,269 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:13:51,270 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone"]
2013-10-31 16:13:51,271 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:13:51,271 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:13:51,271 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:13:51,272 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...dedpipesplatform/joinnone
2013-10-31 16:13:51,277 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:13:51,277 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:13:51,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:51,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:13:51,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,304 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar. blk_-783758398959565497_1231
2013-10-31 16:13:51,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:35384 dest: /127.0.0.1:38271
2013-10-31 16:13:51,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:35316 dest: /127.0.0.1:50942
2013-10-31 16:13:51,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:48419 dest: /127.0.0.1:47311
2013-10-31 16:13:51,320 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48419, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-783758398959565497_1231, duration: 8280493
2013-10-31 16:13:51,320 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-783758398959565497_1231 terminating
2013-10-31 16:13:51,321 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35316, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-783758398959565497_1231, duration: 8125976
2013-10-31 16:13:51,321 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-783758398959565497_1231 terminating
2013-10-31 16:13:51,322 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35384, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-783758398959565497_1231, duration: 9015292
2013-10-31 16:13:51,322 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-783758398959565497_1231 terminating
2013-10-31 16:13:51,324 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:51,324 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar from client DFSClient_1457307213
2013-10-31 16:13:51,325 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar is closed by DFSClient_1457307213
2013-10-31 16:13:51,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:51,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:51,331 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar. New replication is 10
2013-10-31 16:13:51,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar dst=null perm=null
2013-10-31 16:13:51,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,345 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:13:51,350 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:13:51,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:13:51,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,369 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split. New replication is 10
2013-10-31 16:13:51,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=null
2013-10-31 16:13:51,375 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split. blk_-1167122552337763453_1232
2013-10-31 16:13:51,377 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:35318 dest: /127.0.0.1:50942
2013-10-31 16:13:51,379 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:55424 dest: /127.0.0.1:41648
2013-10-31 16:13:51,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:35389 dest: /127.0.0.1:38271
2013-10-31 16:13:51,382 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1167122552337763453_1232 src: /127.0.0.1:48423 dest: /127.0.0.1:47311
2013-10-31 16:13:51,385 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48423, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1167122552337763453_1232, duration: 105811
2013-10-31 16:13:51,386 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,386 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35389, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1167122552337763453_1232, duration: 938909
2013-10-31 16:13:51,387 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,387 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55424, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1167122552337763453_1232, duration: 1944760
2013-10-31 16:13:51,387 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,388 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35318, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1167122552337763453_1232, duration: 2795439
2013-10-31 16:13:51,388 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,388 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1167122552337763453_1232 terminating
2013-10-31 16:13:51,390 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,391 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,391 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1167122552337763453_1232 size 1732
2013-10-31 16:13:51,392 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split from client DFSClient_1457307213
2013-10-31 16:13:51,392 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split is closed by DFSClient_1457307213
2013-10-31 16:13:51,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,411 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo. blk_-8994134656658539248_1233
2013-10-31 16:13:51,413 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8994134656658539248_1233 src: /127.0.0.1:35322 dest: /127.0.0.1:50942
2013-10-31 16:13:51,414 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8994134656658539248_1233 src: /127.0.0.1:48425 dest: /127.0.0.1:47311
2013-10-31 16:13:51,416 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8994134656658539248_1233 src: /127.0.0.1:35393 dest: /127.0.0.1:38271
2013-10-31 16:13:51,419 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35393, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8994134656658539248_1233, duration: 64038
2013-10-31 16:13:51,419 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8994134656658539248_1233 terminating
2013-10-31 16:13:51,419 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8994134656658539248_1233 size 183
2013-10-31 16:13:51,419 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48425, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8994134656658539248_1233, duration: 882972
2013-10-31 16:13:51,420 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8994134656658539248_1233 terminating
2013-10-31 16:13:51,420 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8994134656658539248_1233 size 183
2013-10-31 16:13:51,420 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35322, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8994134656658539248_1233, duration: 1792590
2013-10-31 16:13:51,421 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8994134656658539248_1233 terminating
2013-10-31 16:13:51,423 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:13:51,423 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:13:51,425 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8994134656658539248_1233 size 183
2013-10-31 16:13:51,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:51,448 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml. blk_1512274723573382003_1234
2013-10-31 16:13:51,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1512274723573382003_1234 src: /127.0.0.1:48427 dest: /127.0.0.1:47311
2013-10-31 16:13:51,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1512274723573382003_1234 src: /127.0.0.1:35395 dest: /127.0.0.1:38271
2013-10-31 16:13:51,452 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1512274723573382003_1234 src: /127.0.0.1:35327 dest: /127.0.0.1:50942
2013-10-31 16:13:51,455 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35327, dest: /127.0.0.1:50942, bytes: 28297, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1512274723573382003_1234, duration: 504003
2013-10-31 16:13:51,456 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1512274723573382003_1234 terminating
2013-10-31 16:13:51,456 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35395, dest: /127.0.0.1:38271, bytes: 28297, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1512274723573382003_1234, duration: 938601
2013-10-31 16:13:51,457 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1512274723573382003_1234 terminating
2013-10-31 16:13:51,457 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1512274723573382003_1234 size 28297
2013-10-31 16:13:51,457 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48427, dest: /127.0.0.1:47311, bytes: 28297, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1512274723573382003_1234, duration: 1796713
2013-10-31 16:13:51,457 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1512274723573382003_1234 size 28297
2013-10-31 16:13:51,458 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1512274723573382003_1234 terminating
2013-10-31 16:13:51,459 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml from client DFSClient_1457307213
2013-10-31 16:13:51,460 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml is closed by DFSClient_1457307213
2013-10-31 16:13:51,461 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1512274723573382003_1234 size 28297
2013-10-31 16:13:52,018 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data6/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:52,018 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data5/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:52,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data6/current/blk_-4227185307943247060
2013-10-31 16:13:52,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data5/current/blk_-4109011025327673168
2013-10-31 16:13:52,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295404966245382265_1224 file build/test/data/dfs/data/data6/current/blk_295404966245382265 for deletion
2013-10-31 16:13:52,020 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2391612123643840912_1220 file build/test/data/dfs/data/data6/current/blk_2391612123643840912 for deletion
2013-10-31 16:13:52,020 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295404966245382265_1224 at file build/test/data/dfs/data/data6/current/blk_295404966245382265
2013-10-31 16:13:52,020 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2391612123643840912_1220 at file build/test/data/dfs/data/data6/current/blk_2391612123643840912
2013-10-31 16:13:53,367 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:53,368 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0020 being deleted.
2013-10-31 16:13:53,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml dst=null perm=null
2013-10-31 16:13:53,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35398, bytes: 28521, op: HDFS_READ, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1512274723573382003_1234, duration: 414421
2013-10-31 16:13:53,419 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0021: nMaps=5 nReduces=0 max=-1
2013-10-31 16:13:53,420 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0021 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:13:53,420 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0021 RESULT=SUCCESS
2013-10-31 16:13:53,420 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0021
2013-10-31 16:13:53,420 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0021
2013-10-31 16:13:53,421 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0021
2013-10-31 16:13:53,610 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1252 Total time for transactions(ms): 26Number of transactions batched in Syncs: 128 Number of syncs: 892 SyncTimes(ms): 38844 6451
2013-10-31 16:13:53,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:54,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:54,009 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4227185307943247060_1218 file build/test/data/dfs/data/data7/current/blk_-4227185307943247060 for deletion
2013-10-31 16:13:54,009 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4109011025327673168_1219 file build/test/data/dfs/data/data8/current/blk_-4109011025327673168 for deletion
2013-10-31 16:13:54,010 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4227185307943247060_1218 at file build/test/data/dfs/data/data7/current/blk_-4227185307943247060
2013-10-31 16:13:54,010 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4109011025327673168_1219 at file build/test/data/dfs/data/data8/current/blk_-4109011025327673168
2013-10-31 16:13:54,010 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml. blk_-3040086649751188610_1236
2013-10-31 16:13:54,010 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_218933756069317154_1221 file build/test/data/dfs/data/data8/current/blk_218933756069317154 for deletion
2013-10-31 16:13:54,011 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2391612123643840912_1220 file build/test/data/dfs/data/data7/current/blk_2391612123643840912 for deletion
2013-10-31 16:13:54,011 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_218933756069317154_1221 at file build/test/data/dfs/data/data8/current/blk_218933756069317154
2013-10-31 16:13:54,011 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2391612123643840912_1220 at file build/test/data/dfs/data/data7/current/blk_2391612123643840912
2013-10-31 16:13:54,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3040086649751188610_1236 src: /127.0.0.1:35399 dest: /127.0.0.1:38271
2013-10-31 16:13:54,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3040086649751188610_1236 src: /127.0.0.1:35331 dest: /127.0.0.1:50942
2013-10-31 16:13:54,016 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3040086649751188610_1236 src: /127.0.0.1:48434 dest: /127.0.0.1:47311
2013-10-31 16:13:54,020 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48434, dest: /127.0.0.1:47311, bytes: 28362, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3040086649751188610_1236, duration: 979359
2013-10-31 16:13:54,020 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3040086649751188610_1236 terminating
2013-10-31 16:13:54,021 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35331, dest: /127.0.0.1:50942, bytes: 28362, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3040086649751188610_1236, duration: 1813100
2013-10-31 16:13:54,021 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3040086649751188610_1236 terminating
2013-10-31 16:13:54,021 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3040086649751188610_1236 size 28362
2013-10-31 16:13:54,022 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35399, dest: /127.0.0.1:38271, bytes: 28362, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3040086649751188610_1236, duration: 2935291
2013-10-31 16:13:54,022 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3040086649751188610_1236 terminating
2013-10-31 16:13:54,024 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml from client DFSClient_1797627655
2013-10-31 16:13:54,025 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_conf.xml is closed by DFSClient_1797627655
2013-10-31 16:13:54,025 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3040086649751188610_1236 size 28362
2013-10-31 16:13:54,026 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3040086649751188610_1236 size 28362
2013-10-31 16:13:54,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:13:54,037 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken. blk_6670313106925088236_1237
2013-10-31 16:13:54,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6670313106925088236_1237 src: /127.0.0.1:55438 dest: /127.0.0.1:41648
2013-10-31 16:13:54,040 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6670313106925088236_1237 src: /127.0.0.1:48436 dest: /127.0.0.1:47311
2013-10-31 16:13:54,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6670313106925088236_1237 src: /127.0.0.1:35404 dest: /127.0.0.1:38271
2013-10-31 16:13:54,044 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35404, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6670313106925088236_1237, duration: 63997
2013-10-31 16:13:54,045 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6670313106925088236_1237 terminating
2013-10-31 16:13:54,045 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48436, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6670313106925088236_1237, duration: 854947
2013-10-31 16:13:54,046 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6670313106925088236_1237 terminating
2013-10-31 16:13:54,046 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6670313106925088236_1237 size 116
2013-10-31 16:13:54,046 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55438, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6670313106925088236_1237, duration: 1775883
2013-10-31 16:13:54,047 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6670313106925088236_1237 terminating
2013-10-31 16:13:54,049 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6670313106925088236_1237 size 116
2013-10-31 16:13:54,049 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken from client DFSClient_1457307213
2013-10-31 16:13:54,049 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken is closed by DFSClient_1457307213
2013-10-31 16:13:54,050 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6670313106925088236_1237 size 116
2013-10-31 16:13:54,055 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken
2013-10-31 16:13:54,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.splitmetainfo dst=null perm=null
2013-10-31 16:13:54,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35405, bytes: 187, op: HDFS_READ, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8994134656658539248_1233, duration: 270166
2013-10-31 16:13:54,061 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0021 = 19. Number of splits = 5
2013-10-31 16:13:54,061 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,061 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0021_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:13:54,065 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0021 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:13:54,065 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0021 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:13:54,151 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0021_m_000006_0' to tip task_20131031160444934_0021_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:13:54,159 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:13:54,159 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000006_0 which needs 1 slots
2013-10-31 16:13:54,159 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000006_0 which needs 1 slots
2013-10-31 16:13:54,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken dst=null perm=null
2013-10-31 16:13:54,167 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48439, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6670313106925088236_1237, duration: 287562
2013-10-31 16:13:54,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml dst=null perm=null
2013-10-31 16:13:54,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35339, bytes: 28521, op: HDFS_READ, cliID: DFSClient_694759781, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1512274723573382003_1234, duration: 378560
2013-10-31 16:13:54,207 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:13:54,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar dst=null perm=null
2013-10-31 16:13:54,232 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35409, bytes: 239915, op: HDFS_READ, cliID: DFSClient_694759781, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-783758398959565497_1231, duration: 1313300
2013-10-31 16:13:54,269 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-783758398959565497_1231 to datanode(s) 127.0.0.1:41648
2013-10-31 16:13:54,269 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_295404966245382265_1224
2013-10-31 16:13:54,270 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_295404966245382265_1224
2013-10-31 16:13:54,342 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0020_m_2133656262
2013-10-31 16:13:54,349 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21901 with signal TERM. Exit code 0
2013-10-31 16:13:54,349 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_1540783417
2013-10-31 16:13:54,350 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_1540783417 spawned.
2013-10-31 16:13:54,356 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000006_0/taskjvm.sh
2013-10-31 16:13:54,405 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-783758398959565497_1231 to 127.0.0.1:41648
2013-10-31 16:13:54,406 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295404966245382265_1224 file build/test/data/dfs/data/data4/current/blk_295404966245382265 for deletion
2013-10-31 16:13:54,406 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295404966245382265_1224 at file build/test/data/dfs/data/data4/current/blk_295404966245382265
2013-10-31 16:13:54,407 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-783758398959565497_1231 src: /127.0.0.1:55446 dest: /127.0.0.1:41648
2013-10-31 16:13:54,408 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-783758398959565497_1231 to /127.0.0.1:41648
2013-10-31 16:13:54,409 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-783758398959565497_1231 src: /127.0.0.1:55446 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:13:54,410 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-783758398959565497_1231 size 238055
2013-10-31 16:13:54,413 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:54,413 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:54,413 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:54,413 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_2133656262 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:55,706 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_1540783417 given task: attempt_20131031160444934_0021_m_000006_0
2013-10-31 16:13:56,058 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:56,058 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000000_0 not found in cache
2013-10-31 16:13:56,058 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000001_0 not found in cache
2013-10-31 16:13:56,058 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000005_0 not found in cache
2013-10-31 16:13:56,059 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0020 for user-log deletion with retainTimeStamp:1383322436059
2013-10-31 16:13:56,147 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:56,147 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000003_0 not found in cache
2013-10-31 16:13:56,147 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000002_0 not found in cache
2013-10-31 16:13:56,148 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0020 for user-log deletion with retainTimeStamp:1383322436148
2013-10-31 16:13:56,149 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0020
2013-10-31 16:13:56,149 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0020_m_000004_0 not found in cache
2013-10-31 16:13:56,150 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0020 for user-log deletion with retainTimeStamp:1383322436150
2013-10-31 16:13:56,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:13:56,387 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_-114402403 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:56,397 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21868 with signal TERM. Exit code 0
2013-10-31 16:13:56,407 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_1147863550 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:56,419 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21900 with signal TERM. Exit code 0
2013-10-31 16:13:56,591 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:56,591 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:56,592 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:56,592 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_-114402403 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:56,596 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:56,596 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:56,596 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:56,596 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_1147863550 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:56,807 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295404966245382265_1224 file build/test/data/dfs/data/data2/current/blk_295404966245382265 for deletion
2013-10-31 16:13:56,807 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295404966245382265_1224 at file build/test/data/dfs/data/data2/current/blk_295404966245382265
2013-10-31 16:13:57,142 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_-1766447982 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:57,152 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21653 with signal TERM. Exit code 0
2013-10-31 16:13:57,319 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:57,319 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:57,320 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:57,320 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_-1766447982 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:13:57,446 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0020_m_1620994915 since job job_20131031160444934_0020 is dead
2013-10-31 16:13:57,455 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21785 with signal TERM. Exit code 0
2013-10-31 16:13:57,640 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:13:57,641 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:13:57,641 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:13:57,641 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0020_m_1620994915 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:13:59,123 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000006_0 0.0% setup
2013-10-31 16:13:59,126 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000006_0 is done.
2013-10-31 16:13:59,126 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000006_0 was -1
2013-10-31 16:13:59,126 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:00,165 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000006_0' has completed task_20131031160444934_0021_m_000006 successfully.
2013-10-31 16:14:00,168 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000000_0' to tip task_20131031160444934_0021_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:00,169 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000000
2013-10-31 16:14:00,170 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000001_0' to tip task_20131031160444934_0021_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:00,170 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000001
2013-10-31 16:14:00,172 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000002_0' to tip task_20131031160444934_0021_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:14:00,173 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:14:00,174 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000002
2013-10-31 16:14:00,174 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:14:00,175 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000003_0' to tip task_20131031160444934_0021_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:14:00,175 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000000_0 which needs 1 slots
2013-10-31 16:14:00,175 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000000_0 which needs 1 slots
2013-10-31 16:14:00,175 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000003
2013-10-31 16:14:00,176 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000001_0 which needs 1 slots
2013-10-31 16:14:00,176 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0021_m_000001_0 which needs 1 slots
2013-10-31 16:14:00,181 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:14:00,186 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:14:00,187 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000002_0 which needs 1 slots
2013-10-31 16:14:00,188 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000002_0 which needs 1 slots
2013-10-31 16:14:00,188 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000003_0 which needs 1 slots
2013-10-31 16:14:00,189 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0021_m_000003_0 which needs 1 slots
2013-10-31 16:14:00,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken dst=null perm=null
2013-10-31 16:14:00,197 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35414, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6670313106925088236_1237, duration: 290545
2013-10-31 16:14:00,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml dst=null perm=null
2013-10-31 16:14:00,208 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48449, bytes: 28521, op: HDFS_READ, cliID: DFSClient_1593933664, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1512274723573382003_1234, duration: 380739
2013-10-31 16:14:00,230 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_1814097211
2013-10-31 16:14:00,231 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_1814097211 spawned.
2013-10-31 16:14:00,233 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0021/attempt_20131031160444934_0021_m_000000_0. Attempting to reuse: jvm_20131031160444934_0021_m_1540783417
2013-10-31 16:14:00,234 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000001_0/taskjvm.sh
2013-10-31 16:14:00,336 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:00,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar dst=null perm=null
2013-10-31 16:14:00,358 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55453, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1593933664, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-783758398959565497_1231, duration: 701158
2013-10-31 16:14:00,412 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_-1019684994
2013-10-31 16:14:00,413 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_-1019684994 spawned.
2013-10-31 16:14:00,413 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_-1214335477
2013-10-31 16:14:00,414 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_-1214335477 spawned.
2013-10-31 16:14:00,414 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000002_0/taskjvm.sh
2013-10-31 16:14:00,415 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000003_0/taskjvm.sh
2013-10-31 16:14:00,691 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_1540783417 given task: attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:00,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=null
2013-10-31 16:14:00,877 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35420, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1167122552337763453_1232, duration: 196511
2013-10-31 16:14:00,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:00,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:00,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:01,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:01,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:01,173 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48454, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 130330
2013-10-31 16:14:01,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35422, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 142616
2013-10-31 16:14:01,183 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000. blk_-8929482607814041237_1238
2013-10-31 16:14:01,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8929482607814041237_1238 src: /127.0.0.1:35423 dest: /127.0.0.1:38271
2013-10-31 16:14:01,200 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8929482607814041237_1238 src: /127.0.0.1:48457 dest: /127.0.0.1:47311
2013-10-31 16:14:01,200 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8929482607814041237_1238 src: /127.0.0.1:35356 dest: /127.0.0.1:50942
2013-10-31 16:14:01,203 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35356, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 1310205
2013-10-31 16:14:01,203 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8929482607814041237_1238 terminating
2013-10-31 16:14:01,203 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8929482607814041237_1238 size 40
2013-10-31 16:14:01,203 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48457, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8929482607814041237_1238, duration: 1660806
2013-10-31 16:14:01,203 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8929482607814041237_1238 terminating
2013-10-31 16:14:01,204 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35423, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8929482607814041237_1238, duration: 2200956
2013-10-31 16:14:01,204 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8929482607814041237_1238 terminating
2013-10-31 16:14:01,204 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8929482607814041237_1238 size 40
2013-10-31 16:14:01,206 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:01,206 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:01,208 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8929482607814041237_1238 size 40
2013-10-31 16:14:01,244 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:01,244 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000000_0 0.0%
2013-10-31 16:14:01,380 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_1814097211 given task: attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:01,591 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-1019684994 given task: attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:01,615 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-1214335477 given task: attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:01,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=null
2013-10-31 16:14:01,895 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48463, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1167122552337763453_1232, duration: 169549
2013-10-31 16:14:01,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:01,934 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48464, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 124988
2013-10-31 16:14:01,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:01,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:02,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=null
2013-10-31 16:14:02,107 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35434, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1167122552337763453_1232, duration: 164836
2013-10-31 16:14:02,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=null
2013-10-31 16:14:02,119 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55471, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1167122552337763453_1232, duration: 156535
2013-10-31 16:14:02,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:02,147 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35367, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 141841
2013-10-31 16:14:02,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:02,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:02,160 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35368, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 128429
2013-10-31 16:14:02,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:02,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:02,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:02,166 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55474, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 111462
2013-10-31 16:14:02,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:02,176 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001. blk_1176319995048386474_1241
2013-10-31 16:14:02,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1176319995048386474_1241 src: /127.0.0.1:35370 dest: /127.0.0.1:50942
2013-10-31 16:14:02,200 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1176319995048386474_1241 src: /127.0.0.1:35440 dest: /127.0.0.1:38271
2013-10-31 16:14:02,201 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1176319995048386474_1241 src: /127.0.0.1:48474 dest: /127.0.0.1:47311
2013-10-31 16:14:02,205 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48474, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1176319995048386474_1241, duration: 910475
2013-10-31 16:14:02,205 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1176319995048386474_1241 terminating
2013-10-31 16:14:02,205 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35440, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 1676758
2013-10-31 16:14:02,206 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1176319995048386474_1241 terminating
2013-10-31 16:14:02,206 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1176319995048386474_1241 size 40
2013-10-31 16:14:02,207 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35370, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1176319995048386474_1241, duration: 2596684
2013-10-31 16:14:02,207 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1176319995048386474_1241 size 40
2013-10-31 16:14:02,207 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1176319995048386474_1241 terminating
2013-10-31 16:14:02,209 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1176319995048386474_1241 size 40
2013-10-31 16:14:02,209 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:02,210 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:02,376 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0021_m_000004_0' to tip task_20131031160444934_0021_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:02,377 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0021_m_000004
2013-10-31 16:14:02,380 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:14:02,381 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000004_0 which needs 1 slots
2013-10-31 16:14:02,381 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000004_0 which needs 1 slots
2013-10-31 16:14:02,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021/jobToken dst=null perm=null
2013-10-31 16:14:02,393 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55478, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6670313106925088236_1237, duration: 290893
2013-10-31 16:14:02,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.xml dst=null perm=null
2013-10-31 16:14:02,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35444, bytes: 28521, op: HDFS_READ, cliID: DFSClient_2146416705, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1512274723573382003_1234, duration: 156530
2013-10-31 16:14:02,425 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:02,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.jar dst=null perm=null
2013-10-31 16:14:02,440 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35376, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2146416705, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-783758398959565497_1231, duration: 1009015
2013-10-31 16:14:02,528 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0021_m_-170222416
2013-10-31 16:14:02,530 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0021_m_-170222416 spawned.
2013-10-31 16:14:02,532 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0021/attempt_20131031160444934_0021_m_000004_0/taskjvm.sh
2013-10-31 16:14:03,177 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000000_0
2013-10-31 16:14:05,175 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0021_m_000006_0
2013-10-31 16:14:05,175 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0021_m_000006_0
2013-10-31 16:14:05,176 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000006_0 not found in cache
2013-10-31 16:14:05,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0 dst=null perm=null
2013-10-31 16:14:05,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:05,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:05,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:05,949 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55482, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 131664
2013-10-31 16:14:05,958 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002. blk_936374191023625769_1241
2013-10-31 16:14:05,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:05,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:05,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000000_0 dst=null perm=null
2013-10-31 16:14:05,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_936374191023625769_1241 src: /127.0.0.1:48480 dest: /127.0.0.1:47311
2013-10-31 16:14:05,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_936374191023625769_1241 src: /127.0.0.1:55484 dest: /127.0.0.1:41648
2013-10-31 16:14:05,995 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_936374191023625769_1241 src: /127.0.0.1:35380 dest: /127.0.0.1:50942
2013-10-31 16:14:05,997 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35380, dest: /127.0.0.1:50942, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_936374191023625769_1241, duration: 1344195
2013-10-31 16:14:05,997 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_936374191023625769_1241 terminating
2013-10-31 16:14:05,997 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55484, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_936374191023625769_1241, duration: 1447378
2013-10-31 16:14:05,998 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_936374191023625769_1241 terminating
2013-10-31 16:14:05,998 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48480, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_936374191023625769_1241, duration: 1865727
2013-10-31 16:14:05,998 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_936374191023625769_1241 terminating
2013-10-31 16:14:05,999 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_936374191023625769_1241 size 40
2013-10-31 16:14:06,000 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:06,000 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:06,000 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_936374191023625769_1241 size 40
2013-10-31 16:14:06,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_936374191023625769_1241 size 40
2013-10-31 16:14:06,013 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:06,014 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000001_0 0.0%
2013-10-31 16:14:06,046 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:06,046 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000002_0 0.0%
2013-10-31 16:14:06,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:06,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:06,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55486, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 141756
2013-10-31 16:14:06,179 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000001_0
2013-10-31 16:14:06,185 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000002_0
2013-10-31 16:14:06,187 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003. blk_3252984414706521299_1241
2013-10-31 16:14:06,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3252984414706521299_1241 src: /127.0.0.1:35451 dest: /127.0.0.1:38271
2013-10-31 16:14:06,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3252984414706521299_1241 src: /127.0.0.1:48485 dest: /127.0.0.1:47311
2013-10-31 16:14:06,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3252984414706521299_1241 src: /127.0.0.1:55489 dest: /127.0.0.1:41648
2013-10-31 16:14:06,217 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55489, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3252984414706521299_1241, duration: 949388
2013-10-31 16:14:06,217 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3252984414706521299_1241 terminating
2013-10-31 16:14:06,217 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48485, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3252984414706521299_1241, duration: 1290711
2013-10-31 16:14:06,217 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3252984414706521299_1241 terminating
2013-10-31 16:14:06,217 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35451, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3252984414706521299_1241, duration: 1712448
2013-10-31 16:14:06,218 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3252984414706521299_1241 terminating
2013-10-31 16:14:06,218 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3252984414706521299_1241 size 40
2013-10-31 16:14:06,219 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3252984414706521299_1241 size 40
2013-10-31 16:14:06,219 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:06,219 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:06,220 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3252984414706521299_1241 size 40
2013-10-31 16:14:06,269 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:06,269 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 0.0%
2013-10-31 16:14:06,723 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-170222416 given task: attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:06,871 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:06,873 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:06,874 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000000_0 is done.
2013-10-31 16:14:06,874 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000000_0 was -1
2013-10-31 16:14:06,874 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:07,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0 dst=null perm=null
2013-10-31 16:14:07,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:07,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:07,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000001_0 dst=null perm=null
2013-10-31 16:14:07,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0 dst=null perm=null
2013-10-31 16:14:07,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:07,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:07,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000002_0 dst=null perm=null
2013-10-31 16:14:07,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021/job.split dst=null perm=null
2013-10-31 16:14:07,228 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35387, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1167122552337763453_1232, duration: 369914
2013-10-31 16:14:07,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:07,268 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35457, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 260861
2013-10-31 16:14:07,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:07,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:07,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:07,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:14:07,508 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55494, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 140633
2013-10-31 16:14:07,517 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004. blk_-8273281274980003916_1242
2013-10-31 16:14:07,539 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8273281274980003916_1242 src: /127.0.0.1:48492 dest: /127.0.0.1:47311
2013-10-31 16:14:07,541 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8273281274980003916_1242 src: /127.0.0.1:55496 dest: /127.0.0.1:41648
2013-10-31 16:14:07,542 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8273281274980003916_1242 src: /127.0.0.1:35461 dest: /127.0.0.1:38271
2013-10-31 16:14:07,544 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35461, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8273281274980003916_1242, duration: 1443188
2013-10-31 16:14:07,544 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8273281274980003916_1242 terminating
2013-10-31 16:14:07,545 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55496, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8273281274980003916_1242, duration: 1619111
2013-10-31 16:14:07,545 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8273281274980003916_1242 terminating
2013-10-31 16:14:07,545 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48492, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0021_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8273281274980003916_1242, duration: 2496030
2013-10-31 16:14:07,545 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8273281274980003916_1242 size 40
2013-10-31 16:14:07,546 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8273281274980003916_1242 terminating
2013-10-31 16:14:07,546 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8273281274980003916_1242 size 40
2013-10-31 16:14:07,547 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8273281274980003916_1242 size 40
2013-10-31 16:14:07,547 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:07,548 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:07,613 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0021_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:07,613 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000004_0 0.0%
2013-10-31 16:14:07,864 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:07,867 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:07,868 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000001_0 is done.
2013-10-31 16:14:07,869 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000001_0 was -1
2013-10-31 16:14:07,869 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:08,064 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:08,068 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:08,069 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000002_0 is done.
2013-10-31 16:14:08,069 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000002_0 was -1
2013-10-31 16:14:08,069 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:08,075 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:08,389 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000004_0
2013-10-31 16:14:08,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0 dst=null perm=null
2013-10-31 16:14:08,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:08,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:08,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000004_0 dst=null perm=null
2013-10-31 16:14:09,183 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000000_0' has completed task_20131031160444934_0021_m_000000 successfully.
2013-10-31 16:14:09,185 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000001_0' has completed task_20131031160444934_0021_m_000001 successfully.
2013-10-31 16:14:09,189 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000002_0' has completed task_20131031160444934_0021_m_000002 successfully.
2013-10-31 16:14:09,190 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0021_m_000003_0
2013-10-31 16:14:09,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0 dst=null perm=null
2013-10-31 16:14:09,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:10,143 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:10,144 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000004_0 is done.
2013-10-31 16:14:10,144 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000004_0 was -1
2013-10-31 16:14:10,145 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:10,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:10,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary/_attempt_20131031160444934_0021_m_000003_0 dst=null perm=null
2013-10-31 16:14:11,142 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:11,146 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:11,147 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000003_0 is done.
2013-10-31 16:14:11,147 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000003_0 was -1
2013-10-31 16:14:11,148 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:11,393 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000004_0' has completed task_20131031160444934_0021_m_000004 successfully.
2013-10-31 16:14:12,193 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000003_0' has completed task_20131031160444934_0021_m_000003 successfully.
2013-10-31 16:14:12,197 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0021_m_000005_0' to tip task_20131031160444934_0021_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:14:12,199 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0021_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:14:12,200 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0021_m_000005_0 which needs 1 slots
2013-10-31 16:14:12,200 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0021_m_000005_0 which needs 1 slots
2013-10-31 16:14:12,229 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0021/attempt_20131031160444934_0021_m_000005_0. Attempting to reuse: jvm_20131031160444934_0021_m_-1214335477
2013-10-31 16:14:12,685 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0021_m_-1214335477 given task: attempt_20131031160444934_0021_m_000005_0
2013-10-31 16:14:12,782 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000005_0 0.0%
2013-10-31 16:14:12,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary dst=null perm=null
2013-10-31 16:14:12,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:12,804 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_SUCCESS from client DFSClient_attempt_20131031160444934_0021_m_000005_0
2013-10-31 16:14:12,804 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0021_m_000005_0
2013-10-31 16:14:12,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,813 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-783758398959565497 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:12,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1167122552337763453 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:12,814 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8994134656658539248 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8994134656658539248 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8994134656658539248 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1512274723573382003 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:12,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1512274723573382003 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:12,816 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1512274723573382003 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:12,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0021 dst=null perm=null
2013-10-31 16:14:15,273 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-783758398959565497_1231 blk_-1167122552337763453_1232
2013-10-31 16:14:15,273 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_1512274723573382003_1234 blk_-783758398959565497_1231 blk_-1167122552337763453_1232 blk_-8994134656658539248_1233
2013-10-31 16:14:15,756 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0021_m_000005_0 0.0% cleanup
2013-10-31 16:14:15,758 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0021_m_000005_0 is done.
2013-10-31 16:14:15,758 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0021_m_000005_0 was -1
2013-10-31 16:14:15,758 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:16,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data6/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:16,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data6/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:16,037 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data6/current/blk_-1167122552337763453
2013-10-31 16:14:16,037 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data6/current/blk_-783758398959565497
2013-10-31 16:14:18,018 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8994134656658539248_1233 file build/test/data/dfs/data/data7/current/blk_-8994134656658539248 for deletion
2013-10-31 16:14:18,018 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data8/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:18,018 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8994134656658539248_1233 at file build/test/data/dfs/data/data7/current/blk_-8994134656658539248
2013-10-31 16:14:18,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data8/current/blk_-1167122552337763453
2013-10-31 16:14:18,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data7/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:18,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1512274723573382003_1234 file build/test/data/dfs/data/data8/current/blk_1512274723573382003 for deletion
2013-10-31 16:14:18,020 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data7/current/blk_-783758398959565497
2013-10-31 16:14:18,020 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1512274723573382003_1234 at file build/test/data/dfs/data/data8/current/blk_1512274723573382003
2013-10-31 16:14:18,206 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0021_m_000005_0' has completed task_20131031160444934_0021_m_000005 successfully.
2013-10-31 16:14:18,207 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0021 has completed successfully.
2013-10-31 16:14:18,207 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0021,submitTime=1383236033391,launchTime=1383236034065,firstMapTaskLaunchTime=1383236040168,firstJobSetupTaskLaunchTime=1383236034151,firstJobCleanupTaskLaunchTime=1383236052197,finishTime=1383236058207,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=48,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[40059A3D98A44FF1ACD4467F4697661C/5993B28B7E41438FB05DA3B1E4AF04BD] lower*upper/(1/1) ...dedpipesplatform/joinnone
2013-10-31 16:14:18,216 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F. blk_-5995995560352840120_1243
2013-10-31 16:14:18,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5995995560352840120_1243 src: /127.0.0.1:55500 dest: /127.0.0.1:41648
2013-10-31 16:14:18,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5995995560352840120_1243 src: /127.0.0.1:35396 dest: /127.0.0.1:50942
2013-10-31 16:14:18,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5995995560352840120_1243 src: /127.0.0.1:35466 dest: /127.0.0.1:38271
2013-10-31 16:14:18,230 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35466, dest: /127.0.0.1:38271, bytes: 26371, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5995995560352840120_1243, duration: 3695606
2013-10-31 16:14:18,231 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5995995560352840120_1243 terminating
2013-10-31 16:14:18,231 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35396, dest: /127.0.0.1:50942, bytes: 26371, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5995995560352840120_1243, duration: 3904422
2013-10-31 16:14:18,232 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5995995560352840120_1243 terminating
2013-10-31 16:14:18,236 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55500, dest: /127.0.0.1:41648, bytes: 26371, op: HDFS_WRITE, cliID: DFSClient_1797627655, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5995995560352840120_1243, duration: 5345670
2013-10-31 16:14:18,236 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5995995560352840120_1243 size 26371
2013-10-31 16:14:18,236 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5995995560352840120_1243 terminating
2013-10-31 16:14:18,241 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5995995560352840120_1243 size 26371
2013-10-31 16:14:18,241 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F from client DFSClient_1797627655
2013-10-31 16:14:18,242 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_logs/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F is closed by DFSClient_1797627655
2013-10-31 16:14:18,242 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5995995560352840120_1243 size 26371
2013-10-31 16:14:18,248 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0021_1383236033391_hadoop_%5B40059A3D98A44FF1ACD4467F4697661C%2F5993B28B7E41438F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:18,248 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000002_0'
2013-10-31 16:14:18,249 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000003_0'
2013-10-31 16:14:18,249 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000005_0'
2013-10-31 16:14:18,250 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6670313106925088236 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:18,251 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6670313106925088236 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:18,251 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6670313106925088236 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:18,254 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0021_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:18,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0021 dst=null perm=null
2013-10-31 16:14:18,258 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/_temporary
2013-10-31 16:14:18,274 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_6670313106925088236_1237 blk_1512274723573382003_1234 blk_-783758398959565497_1231 blk_-1167122552337763453_1232 blk_-8994134656658539248_1233
2013-10-31 16:14:18,274 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_6670313106925088236_1237 blk_1512274723573382003_1234 blk_-783758398959565497_1231 blk_-1167122552337763453_1232 blk_-8994134656658539248_1233
2013-10-31 16:14:18,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=null
2013-10-31 16:14:18,279 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:14:18,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2013-10-31 16:14:18,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2013-10-31 16:14:18,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2013-10-31 16:14:18,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2013-10-31 16:14:18,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2013-10-31 16:14:18,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2013-10-31 16:14:18,287 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35399, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 350209
2013-10-31 16:14:18,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2013-10-31 16:14:18,289 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35469, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 273759
2013-10-31 16:14:18,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2013-10-31 16:14:18,291 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48503, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_936374191023625769_1241, duration: 145630
2013-10-31 16:14:18,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2013-10-31 16:14:18,293 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35471, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3252984414706521299_1241, duration: 276262
2013-10-31 16:14:18,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2013-10-31 16:14:18,296 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48505, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8273281274980003916_1242, duration: 277305
2013-10-31 16:14:18,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=null
2013-10-31 16:14:18,304 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:14:18,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2013-10-31 16:14:18,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2013-10-31 16:14:18,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2013-10-31 16:14:18,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2013-10-31 16:14:18,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2013-10-31 16:14:18,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2013-10-31 16:14:18,311 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35404, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 273368
2013-10-31 16:14:18,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2013-10-31 16:14:18,314 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35474, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 271841
2013-10-31 16:14:18,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2013-10-31 16:14:18,316 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48508, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_936374191023625769_1241, duration: 275468
2013-10-31 16:14:18,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2013-10-31 16:14:18,318 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35476, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3252984414706521299_1241, duration: 269672
2013-10-31 16:14:18,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2013-10-31 16:14:18,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55513, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8273281274980003916_1242, duration: 265689
2013-10-31 16:14:18,321 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinnone
2013-10-31 16:14:18,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone dst=null perm=null
2013-10-31 16:14:18,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2013-10-31 16:14:18,327 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35409, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8929482607814041237_1238, duration: 264778
2013-10-31 16:14:18,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2013-10-31 16:14:18,330 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35479, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1176319995048386474_1241, duration: 263501
2013-10-31 16:14:18,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2013-10-31 16:14:18,333 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55516, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_936374191023625769_1241, duration: 265188
2013-10-31 16:14:18,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2013-10-31 16:14:18,336 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55517, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3252984414706521299_1241, duration: 270755
2013-10-31 16:14:18,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2013-10-31 16:14:18,339 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55518, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8273281274980003916_1242, duration: 278416
2013-10-31 16:14:18,348 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:14:18,349 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:14:18,369 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:14:18,369 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:14:18,370 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:14:18,370 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself"]
2013-10-31 16:14:18,370 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:14:18,370 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 16:14:18,370 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 16:14:18,372 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2)
2013-10-31 16:14:18,377 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:14:18,377 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:14:18,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:18,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:14:18,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,401 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar. blk_3030443344262937130_1244
2013-10-31 16:14:18,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:48516 dest: /127.0.0.1:47311
2013-10-31 16:14:18,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:55520 dest: /127.0.0.1:41648
2013-10-31 16:14:18,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:35416 dest: /127.0.0.1:50942
2013-10-31 16:14:18,413 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35416, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3030443344262937130_1244, duration: 5335564
2013-10-31 16:14:18,413 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3030443344262937130_1244 terminating
2013-10-31 16:14:18,413 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8994134656658539248_1233 file build/test/data/dfs/data/data3/current/blk_-8994134656658539248 for deletion
2013-10-31 16:14:18,413 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55520, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3030443344262937130_1244, duration: 5782898
2013-10-31 16:14:18,414 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8994134656658539248_1233 at file build/test/data/dfs/data/data3/current/blk_-8994134656658539248
2013-10-31 16:14:18,413 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data4/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:18,414 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3030443344262937130_1244 terminating
2013-10-31 16:14:18,414 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data4/current/blk_-1167122552337763453
2013-10-31 16:14:18,414 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data3/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:18,414 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48516, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3030443344262937130_1244, duration: 6436638
2013-10-31 16:14:18,415 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data3/current/blk_-783758398959565497
2013-10-31 16:14:18,415 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3030443344262937130_1244 terminating
2013-10-31 16:14:18,415 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1512274723573382003_1234 file build/test/data/dfs/data/data4/current/blk_1512274723573382003 for deletion
2013-10-31 16:14:18,414 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:18,416 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1512274723573382003_1234 at file build/test/data/dfs/data/data4/current/blk_1512274723573382003
2013-10-31 16:14:18,416 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6670313106925088236_1237 file build/test/data/dfs/data/data4/current/blk_6670313106925088236 for deletion
2013-10-31 16:14:18,417 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar from client DFSClient_1457307213
2013-10-31 16:14:18,417 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6670313106925088236_1237 at file build/test/data/dfs/data/data4/current/blk_6670313106925088236
2013-10-31 16:14:18,418 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar is closed by DFSClient_1457307213
2013-10-31 16:14:18,418 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:18,419 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:18,427 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar. New replication is 10
2013-10-31 16:14:18,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar dst=null perm=null
2013-10-31 16:14:18,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,441 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:14:18,443 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:14:18,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:18,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,456 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split. New replication is 10
2013-10-31 16:14:18,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=null
2013-10-31 16:14:18,463 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split. blk_-5412770078617130947_1245
2013-10-31 16:14:18,465 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:35417 dest: /127.0.0.1:50942
2013-10-31 16:14:18,467 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:55523 dest: /127.0.0.1:41648
2013-10-31 16:14:18,468 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:48521 dest: /127.0.0.1:47311
2013-10-31 16:14:18,470 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5412770078617130947_1245 src: /127.0.0.1:35489 dest: /127.0.0.1:38271
2013-10-31 16:14:18,473 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35489, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5412770078617130947_1245, duration: 82208
2013-10-31 16:14:18,473 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,474 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48521, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 804315
2013-10-31 16:14:18,474 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,475 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55523, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5412770078617130947_1245, duration: 1818589
2013-10-31 16:14:18,475 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,475 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,476 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35417, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5412770078617130947_1245, duration: 2601277
2013-10-31 16:14:18,476 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5412770078617130947_1245 terminating
2013-10-31 16:14:18,477 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,478 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split from client DFSClient_1457307213
2013-10-31 16:14:18,478 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split is closed by DFSClient_1457307213
2013-10-31 16:14:18,479 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,480 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5412770078617130947_1245 size 1732
2013-10-31 16:14:18,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:18,496 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo. blk_4201116548825547386_1246
2013-10-31 16:14:18,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4201116548825547386_1246 src: /127.0.0.1:35490 dest: /127.0.0.1:38271
2013-10-31 16:14:18,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4201116548825547386_1246 src: /127.0.0.1:35422 dest: /127.0.0.1:50942
2013-10-31 16:14:18,501 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4201116548825547386_1246 src: /127.0.0.1:55528 dest: /127.0.0.1:41648
2013-10-31 16:14:18,503 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55528, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4201116548825547386_1246, duration: 978091
2013-10-31 16:14:18,504 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4201116548825547386_1246 terminating
2013-10-31 16:14:18,504 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35422, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4201116548825547386_1246, duration: 731085
2013-10-31 16:14:18,505 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4201116548825547386_1246 terminating
2013-10-31 16:14:18,505 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35490, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4201116548825547386_1246, duration: 1574898
2013-10-31 16:14:18,505 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4201116548825547386_1246 size 183
2013-10-31 16:14:18,506 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4201116548825547386_1246 terminating
2013-10-31 16:14:18,511 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4201116548825547386_1246 size 183
2013-10-31 16:14:18,511 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:14:18,512 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:14:18,512 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4201116548825547386_1246 size 183
2013-10-31 16:14:19,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,766 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml. blk_-249330390446619125_1247
2013-10-31 16:14:19,768 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249330390446619125_1247 src: /127.0.0.1:35424 dest: /127.0.0.1:50942
2013-10-31 16:14:19,770 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249330390446619125_1247 src: /127.0.0.1:35494 dest: /127.0.0.1:38271
2013-10-31 16:14:19,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249330390446619125_1247 src: /127.0.0.1:48528 dest: /127.0.0.1:47311
2013-10-31 16:14:19,774 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48528, dest: /127.0.0.1:47311, bytes: 27399, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-249330390446619125_1247, duration: 144023
2013-10-31 16:14:19,774 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-249330390446619125_1247 terminating
2013-10-31 16:14:19,775 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35494, dest: /127.0.0.1:38271, bytes: 27399, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-249330390446619125_1247, duration: 918845
2013-10-31 16:14:19,775 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-249330390446619125_1247 terminating
2013-10-31 16:14:19,776 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35424, dest: /127.0.0.1:50942, bytes: 27399, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-249330390446619125_1247, duration: 1849156
2013-10-31 16:14:19,776 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-249330390446619125_1247 size 27399
2013-10-31 16:14:19,776 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-249330390446619125_1247 terminating
2013-10-31 16:14:19,779 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-249330390446619125_1247 size 27399
2013-10-31 16:14:19,779 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml from client DFSClient_1457307213
2013-10-31 16:14:19,780 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml is closed by DFSClient_1457307213
2013-10-31 16:14:19,780 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-249330390446619125_1247 size 27399
2013-10-31 16:14:19,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml dst=null perm=null
2013-10-31 16:14:19,795 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35428, bytes: 27615, op: HDFS_READ, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-249330390446619125_1247, duration: 431342
2013-10-31 16:14:19,813 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0022: nMaps=5 nReduces=0 max=-1
2013-10-31 16:14:19,814 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0022 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:14:19,814 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0022
2013-10-31 16:14:19,814 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0022 RESULT=SUCCESS
2013-10-31 16:14:19,814 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0022
2013-10-31 16:14:19,815 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0022
2013-10-31 16:14:19,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,852 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml. blk_494178843268810844_1249
2013-10-31 16:14:19,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_494178843268810844_1249 src: /127.0.0.1:35498 dest: /127.0.0.1:38271
2013-10-31 16:14:19,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_494178843268810844_1249 src: /127.0.0.1:55535 dest: /127.0.0.1:41648
2013-10-31 16:14:19,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_494178843268810844_1249 src: /127.0.0.1:48533 dest: /127.0.0.1:47311
2013-10-31 16:14:19,864 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48533, dest: /127.0.0.1:47311, bytes: 27464, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_494178843268810844_1249, duration: 6378221
2013-10-31 16:14:19,865 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_494178843268810844_1249 terminating
2013-10-31 16:14:19,865 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_494178843268810844_1249 size 27464
2013-10-31 16:14:19,865 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55535, dest: /127.0.0.1:41648, bytes: 27464, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_494178843268810844_1249, duration: 2198076
2013-10-31 16:14:19,866 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_494178843268810844_1249 terminating
2013-10-31 16:14:19,867 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35498, dest: /127.0.0.1:38271, bytes: 27464, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_494178843268810844_1249, duration: 3828305
2013-10-31 16:14:19,867 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_494178843268810844_1249 terminating
2013-10-31 16:14:19,869 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml from client DFSClient_1306363302
2013-10-31 16:14:19,869 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_conf.xml is closed by DFSClient_1306363302
2013-10-31 16:14:19,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_494178843268810844_1249 size 27464
2013-10-31 16:14:19,870 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_494178843268810844_1249 size 27464
2013-10-31 16:14:19,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:19,883 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken. blk_-5171279128071141564_1250
2013-10-31 16:14:19,884 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5171279128071141564_1250 src: /127.0.0.1:35501 dest: /127.0.0.1:38271
2013-10-31 16:14:19,886 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5171279128071141564_1250 src: /127.0.0.1:48535 dest: /127.0.0.1:47311
2013-10-31 16:14:19,887 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5171279128071141564_1250 src: /127.0.0.1:55539 dest: /127.0.0.1:41648
2013-10-31 16:14:19,890 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55539, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5171279128071141564_1250, duration: 62665
2013-10-31 16:14:19,891 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5171279128071141564_1250 terminating
2013-10-31 16:14:19,891 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48535, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5171279128071141564_1250, duration: 957144
2013-10-31 16:14:19,892 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5171279128071141564_1250 terminating
2013-10-31 16:14:19,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35501, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5171279128071141564_1250, duration: 1805995
2013-10-31 16:14:19,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5171279128071141564_1250 terminating
2013-10-31 16:14:19,895 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5171279128071141564_1250 size 116
2013-10-31 16:14:19,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5171279128071141564_1250 size 116
2013-10-31 16:14:19,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5171279128071141564_1250 size 116
2013-10-31 16:14:20,296 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken from client DFSClient_1457307213
2013-10-31 16:14:20,297 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken is closed by DFSClient_1457307213
2013-10-31 16:14:20,302 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken
2013-10-31 16:14:20,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.splitmetainfo dst=null perm=null
2013-10-31 16:14:20,307 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35435, bytes: 187, op: HDFS_READ, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4201116548825547386_1246, duration: 353203
2013-10-31 16:14:20,308 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0022 = 19. Number of splits = 5
2013-10-31 16:14:20,308 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,309 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,310 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,311 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,312 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:20,312 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0022 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:14:20,312 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0022 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:14:20,406 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0022_m_000006_0' to tip task_20131031160444934_0022_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:20,411 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000004_0'
2013-10-31 16:14:20,413 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:14:20,414 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000006_0 which needs 1 slots
2013-10-31 16:14:20,414 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000006_0 which needs 1 slots
2013-10-31 16:14:20,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken dst=null perm=null
2013-10-31 16:14:20,422 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55541, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5171279128071141564_1250, duration: 301158
2013-10-31 16:14:20,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml dst=null perm=null
2013-10-31 16:14:20,432 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48540, bytes: 27615, op: HDFS_READ, cliID: DFSClient_-1302019940, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-249330390446619125_1247, duration: 389043
2013-10-31 16:14:20,463 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:20,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar dst=null perm=null
2013-10-31 16:14:20,491 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55544, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1302019940, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3030443344262937130_1244, duration: 1056060
2013-10-31 16:14:20,577 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:20,577 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_-1610034685 spawned.
2013-10-31 16:14:20,578 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000006_0/taskjvm.sh
2013-10-31 16:14:20,815 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8994134656658539248_1233 file build/test/data/dfs/data/data2/current/blk_-8994134656658539248 for deletion
2013-10-31 16:14:20,815 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1167122552337763453_1232 file build/test/data/dfs/data/data1/current/blk_-1167122552337763453 for deletion
2013-10-31 16:14:20,815 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8994134656658539248_1233 at file build/test/data/dfs/data/data2/current/blk_-8994134656658539248
2013-10-31 16:14:20,816 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-783758398959565497_1231 file build/test/data/dfs/data/data2/current/blk_-783758398959565497 for deletion
2013-10-31 16:14:20,816 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1167122552337763453_1232 at file build/test/data/dfs/data/data1/current/blk_-1167122552337763453
2013-10-31 16:14:20,816 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1512274723573382003_1234 file build/test/data/dfs/data/data1/current/blk_1512274723573382003 for deletion
2013-10-31 16:14:20,816 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-783758398959565497_1231 at file build/test/data/dfs/data/data2/current/blk_-783758398959565497
2013-10-31 16:14:20,816 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6670313106925088236_1237 file build/test/data/dfs/data/data1/current/blk_6670313106925088236 for deletion
2013-10-31 16:14:20,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1512274723573382003_1234 at file build/test/data/dfs/data/data1/current/blk_1512274723573382003
2013-10-31 16:14:20,817 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6670313106925088236_1237 at file build/test/data/dfs/data/data1/current/blk_6670313106925088236
2013-10-31 16:14:21,093 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:21,093 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0021 being deleted.
2013-10-31 16:14:21,199 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000000_0'
2013-10-31 16:14:21,199 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000001_0'
2013-10-31 16:14:21,199 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0021_m_000006_0'
2013-10-31 16:14:21,275 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_3030443344262937130_1244 to datanode(s) 127.0.0.1:38271
2013-10-31 16:14:21,276 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_6670313106925088236_1237
2013-10-31 16:14:21,415 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_3030443344262937130_1244 to 127.0.0.1:38271
2013-10-31 16:14:21,417 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3030443344262937130_1244 src: /127.0.0.1:35509 dest: /127.0.0.1:38271
2013-10-31 16:14:21,417 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_3030443344262937130_1244 to /127.0.0.1:38271
2013-10-31 16:14:21,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3030443344262937130_1244 src: /127.0.0.1:35509 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:14:21,422 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3030443344262937130_1244 size 238055
2013-10-31 16:14:22,028 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6670313106925088236_1237 file build/test/data/dfs/data/data5/current/blk_6670313106925088236 for deletion
2013-10-31 16:14:22,028 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6670313106925088236_1237 at file build/test/data/dfs/data/data5/current/blk_6670313106925088236
2013-10-31 16:14:22,937 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1610034685 given task: attempt_20131031160444934_0022_m_000006_0
2013-10-31 16:14:23,251 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:23,251 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000002_0 not found in cache
2013-10-31 16:14:23,251 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000005_0 not found in cache
2013-10-31 16:14:23,251 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000003_0 not found in cache
2013-10-31 16:14:23,252 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0021 for user-log deletion with retainTimeStamp:1383322463252
2013-10-31 16:14:23,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:23,636 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_-1019684994 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:23,647 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22443 with signal TERM. Exit code 0
2013-10-31 16:14:23,819 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:23,819 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:23,819 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:23,820 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_-1019684994 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:24,086 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_-1214335477 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:24,096 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22473 with signal TERM. Exit code 0
2013-10-31 16:14:24,260 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:24,260 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:24,260 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:24,260 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_-1214335477 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:14:25,414 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:25,414 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000004_0 not found in cache
2013-10-31 16:14:25,415 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0021 for user-log deletion with retainTimeStamp:1383322465415
2013-10-31 16:14:25,708 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_-170222416 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:25,720 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22614 with signal TERM. Exit code 0
2013-10-31 16:14:25,902 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:25,902 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:25,902 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:25,903 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_-170222416 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:26,200 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0021
2013-10-31 16:14:26,200 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000000_0 not found in cache
2013-10-31 16:14:26,201 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0021_m_000001_0 not found in cache
2013-10-31 16:14:26,201 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0021 for user-log deletion with retainTimeStamp:1383322466201
2013-10-31 16:14:26,383 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000006_0 0.0% setup
2013-10-31 16:14:26,386 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000006_0 is done.
2013-10-31 16:14:26,386 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000006_0 was -1
2013-10-31 16:14:26,387 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:26,419 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000006_0' has completed task_20131031160444934_0022_m_000006 successfully.
2013-10-31 16:14:26,420 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000000_0' to tip task_20131031160444934_0022_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:26,421 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000000
2013-10-31 16:14:26,421 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000001_0' to tip task_20131031160444934_0022_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:26,421 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000001
2013-10-31 16:14:26,423 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:14:26,424 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:14:26,424 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000000_0 which needs 1 slots
2013-10-31 16:14:26,424 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000000_0 which needs 1 slots
2013-10-31 16:14:26,424 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000001_0 which needs 1 slots
2013-10-31 16:14:26,424 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0022_m_000001_0 which needs 1 slots
2013-10-31 16:14:26,441 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_1814097211 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:26,443 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_-1349535248
2013-10-31 16:14:26,444 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_-1349535248 spawned.
2013-10-31 16:14:26,445 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000000_0/taskjvm.sh
2013-10-31 16:14:26,446 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22390 with signal TERM. Exit code 0
2013-10-31 16:14:26,462 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0022/attempt_20131031160444934_0022_m_000001_0. Attempting to reuse: jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:26,599 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:26,599 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:26,600 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:26,600 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_1814097211 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:26,912 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0021_m_1540783417 since job job_20131031160444934_0021 is dead
2013-10-31 16:14:26,920 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22255 with signal TERM. Exit code 0
2013-10-31 16:14:26,944 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1610034685 given task: attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:27,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=null
2013-10-31 16:14:27,048 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35444, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5412770078617130947_1245, duration: 188943
2013-10-31 16:14:27,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:27,091 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48547, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 418031
2013-10-31 16:14:27,095 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:27,096 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:27,096 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:27,097 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0021_m_1540783417 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:14:27,101 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000002_0' to tip task_20131031160444934_0022_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:27,101 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000002
2013-10-31 16:14:27,101 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000003_0' to tip task_20131031160444934_0022_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:27,101 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000003
2013-10-31 16:14:27,103 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:14:27,104 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:14:27,104 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000002_0 which needs 1 slots
2013-10-31 16:14:27,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:27,104 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000002_0 which needs 1 slots
2013-10-31 16:14:27,104 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000003_0 which needs 1 slots
2013-10-31 16:14:27,104 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0022_m_000003_0 which needs 1 slots
2013-10-31 16:14:27,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken dst=null perm=null
2013-10-31 16:14:27,112 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48548, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5171279128071141564_1250, duration: 183179
2013-10-31 16:14:27,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml dst=null perm=null
2013-10-31 16:14:27,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35518, bytes: 27615, op: HDFS_READ, cliID: DFSClient_-539769386, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-249330390446619125_1247, duration: 387480
2013-10-31 16:14:27,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:27,145 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:27,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar dst=null perm=null
2013-10-31 16:14:27,159 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35450, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-539769386, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3030443344262937130_1244, duration: 694045
2013-10-31 16:14:27,205 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0022_m_000004_0' to tip task_20131031160444934_0022_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:27,205 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0022_m_000004
2013-10-31 16:14:27,206 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:14:27,206 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000004_0 which needs 1 slots
2013-10-31 16:14:27,206 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000004_0 which needs 1 slots
2013-10-31 16:14:27,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022/jobToken dst=null perm=null
2013-10-31 16:14:27,210 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35520, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5171279128071141564_1250, duration: 140062
2013-10-31 16:14:27,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.xml dst=null perm=null
2013-10-31 16:14:27,214 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_1625766810
2013-10-31 16:14:27,215 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_1625766810 spawned.
2013-10-31 16:14:27,215 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35522, bytes: 27615, op: HDFS_READ, cliID: DFSClient_-57388609, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-249330390446619125_1247, duration: 581142
2013-10-31 16:14:27,215 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_-1787526564
2013-10-31 16:14:27,216 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_-1787526564 spawned.
2013-10-31 16:14:27,217 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000003_0/taskjvm.sh
2013-10-31 16:14:27,217 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000002_0/taskjvm.sh
2013-10-31 16:14:27,288 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1349535248 given task: attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:27,579 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001. blk_7071146985674685312_1251
2013-10-31 16:14:27,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7071146985674685312_1251 src: /127.0.0.1:48556 dest: /127.0.0.1:47311
2013-10-31 16:14:27,604 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:27,605 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7071146985674685312_1251 src: /127.0.0.1:55560 dest: /127.0.0.1:41648
2013-10-31 16:14:27,606 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7071146985674685312_1251 src: /127.0.0.1:35525 dest: /127.0.0.1:38271
2013-10-31 16:14:27,609 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35525, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7071146985674685312_1251, duration: 608755
2013-10-31 16:14:27,609 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7071146985674685312_1251 size 92
2013-10-31 16:14:27,609 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7071146985674685312_1251 terminating
2013-10-31 16:14:27,609 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55560, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7071146985674685312_1251, duration: 1596556
2013-10-31 16:14:27,610 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7071146985674685312_1251 terminating
2013-10-31 16:14:27,610 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48556, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7071146985674685312_1251, duration: 2042807
2013-10-31 16:14:27,610 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7071146985674685312_1251 terminating
2013-10-31 16:14:27,611 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7071146985674685312_1251 size 92
2013-10-31 16:14:27,613 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7071146985674685312_1251 size 92
2013-10-31 16:14:27,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.jar dst=null perm=null
2013-10-31 16:14:27,621 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48559, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-57388609, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3030443344262937130_1244, duration: 847757
2013-10-31 16:14:27,644 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:27,644 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:27,686 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_1921536696
2013-10-31 16:14:27,686 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:27,687 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_1921536696 spawned.
2013-10-31 16:14:27,687 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000001_0 0.0%
2013-10-31 16:14:27,688 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000004_0/taskjvm.sh
2013-10-31 16:14:28,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=null
2013-10-31 16:14:28,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48561, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 186080
2013-10-31 16:14:28,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:28,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:28,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:28,377 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_1625766810 given task: attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:28,394 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35462, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 130544
2013-10-31 16:14:28,398 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000. blk_6836394959299064328_1252
2013-10-31 16:14:28,408 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_-1787526564 given task: attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:28,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6836394959299064328_1252 src: /127.0.0.1:48565 dest: /127.0.0.1:47311
2013-10-31 16:14:28,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6836394959299064328_1252 src: /127.0.0.1:55569 dest: /127.0.0.1:41648
2013-10-31 16:14:28,424 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6836394959299064328_1252 src: /127.0.0.1:35534 dest: /127.0.0.1:38271
2013-10-31 16:14:28,426 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35534, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6836394959299064328_1252, duration: 1139363
2013-10-31 16:14:28,426 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6836394959299064328_1252 terminating
2013-10-31 16:14:28,426 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55569, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6836394959299064328_1252, duration: 1487901
2013-10-31 16:14:28,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6836394959299064328_1252 terminating
2013-10-31 16:14:28,427 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48565, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6836394959299064328_1252, duration: 1864182
2013-10-31 16:14:28,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6836394959299064328_1252 terminating
2013-10-31 16:14:28,428 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6836394959299064328_1252 size 92
2013-10-31 16:14:28,428 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:28,428 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:28,428 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6836394959299064328_1252 size 92
2013-10-31 16:14:28,429 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6836394959299064328_1252 size 92
2013-10-31 16:14:28,477 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:28,477 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000000_0 0.0%
2013-10-31 16:14:28,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=null
2013-10-31 16:14:28,876 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_1921536696 given task: attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:28,880 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35469, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5412770078617130947_1245, duration: 160189
2013-10-31 16:14:28,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=null
2013-10-31 16:14:28,909 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48572, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 149925
2013-10-31 16:14:28,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:28,919 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48573, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 102740
2013-10-31 16:14:28,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:28,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:28,948 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48574, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 112934
2013-10-31 16:14:28,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:28,960 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_147876096733075238_1135
2013-10-31 16:14:29,194 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003. blk_4171475749075851274_1253
2013-10-31 16:14:29,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4171475749075851274_1253 src: /127.0.0.1:48575 dest: /127.0.0.1:47311
2013-10-31 16:14:29,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4171475749075851274_1253 src: /127.0.0.1:35543 dest: /127.0.0.1:38271
2013-10-31 16:14:29,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4171475749075851274_1253 src: /127.0.0.1:35475 dest: /127.0.0.1:50942
2013-10-31 16:14:29,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35475, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4171475749075851274_1253, duration: 1303915
2013-10-31 16:14:29,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4171475749075851274_1253 terminating
2013-10-31 16:14:29,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4171475749075851274_1253 size 92
2013-10-31 16:14:29,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35543, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4171475749075851274_1253, duration: 1408964
2013-10-31 16:14:29,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4171475749075851274_1253 terminating
2013-10-31 16:14:29,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48575, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4171475749075851274_1253, duration: 1973706
2013-10-31 16:14:29,226 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4171475749075851274_1253 terminating
2013-10-31 16:14:29,226 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:29,227 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:29,227 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4171475749075851274_1253 size 92
2013-10-31 16:14:29,228 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4171475749075851274_1253 size 92
2013-10-31 16:14:29,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,390 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:29,390 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000003_0 0.0%
2013-10-31 16:14:29,426 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000000_0
2013-10-31 16:14:29,426 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000001_0
2013-10-31 16:14:29,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022/job.split dst=null perm=null
2013-10-31 16:14:29,437 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48579, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5412770078617130947_1245, duration: 198849
2013-10-31 16:14:29,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:29,476 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35547, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 110906
2013-10-31 16:14:29,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0 dst=null perm=null
2013-10-31 16:14:29,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000000_0 dst=null perm=null
2013-10-31 16:14:29,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,533 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002. blk_5893390770057608854_1255
2013-10-31 16:14:29,557 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5893390770057608854_1255 src: /127.0.0.1:35479 dest: /127.0.0.1:50942
2013-10-31 16:14:29,558 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5893390770057608854_1255 src: /127.0.0.1:48582 dest: /127.0.0.1:47311
2013-10-31 16:14:29,559 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5893390770057608854_1255 src: /127.0.0.1:35550 dest: /127.0.0.1:38271
2013-10-31 16:14:29,563 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35550, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5893390770057608854_1255, duration: 2111419
2013-10-31 16:14:29,563 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5893390770057608854_1255 terminating
2013-10-31 16:14:29,563 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48582, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5893390770057608854_1255, duration: 3297715
2013-10-31 16:14:29,563 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5893390770057608854_1255 terminating
2013-10-31 16:14:29,564 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35479, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 3719378
2013-10-31 16:14:29,564 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5893390770057608854_1255 terminating
2013-10-31 16:14:29,566 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5893390770057608854_1255 size 92
2013-10-31 16:14:29,566 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5893390770057608854_1255 size 92
2013-10-31 16:14:29,568 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5893390770057608854_1255 size 92
2013-10-31 16:14:29,685 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004. blk_-6147278667197761988_1255
2013-10-31 16:14:29,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0 dst=null perm=null
2013-10-31 16:14:29,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:29,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:29,708 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6147278667197761988_1255 src: /127.0.0.1:55587 dest: /127.0.0.1:41648
2013-10-31 16:14:29,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6147278667197761988_1255 src: /127.0.0.1:35483 dest: /127.0.0.1:50942
2013-10-31 16:14:29,710 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6147278667197761988_1255 src: /127.0.0.1:35553 dest: /127.0.0.1:38271
2013-10-31 16:14:29,712 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35553, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6147278667197761988_1255, duration: 1047325
2013-10-31 16:14:29,712 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6147278667197761988_1255 terminating
2013-10-31 16:14:29,712 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35483, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6147278667197761988_1255, duration: 1376559
2013-10-31 16:14:29,712 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6147278667197761988_1255 terminating
2013-10-31 16:14:29,712 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55587, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0022_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6147278667197761988_1255, duration: 1735620
2013-10-31 16:14:29,713 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6147278667197761988_1255 terminating
2013-10-31 16:14:29,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000001_0 dst=null perm=null
2013-10-31 16:14:29,714 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6147278667197761988_1255 size 92
2013-10-31 16:14:29,714 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6147278667197761988_1255 size 92
2013-10-31 16:14:29,717 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6147278667197761988_1255 size 92
2013-10-31 16:14:29,966 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:29,967 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:30,010 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:30,011 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000001_0 is done.
2013-10-31 16:14:30,012 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000001_0 was -1
2013-10-31 16:14:30,012 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:30,033 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:30,033 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000002_0 0.0%
2013-10-31 16:14:30,107 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000002_0
2013-10-31 16:14:30,107 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000003_0
2013-10-31 16:14:30,114 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:30,114 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:30,161 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0022_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:30,162 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000004_0 0.0%
2013-10-31 16:14:30,209 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0022_m_000004_0
2013-10-31 16:14:30,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0 dst=null perm=null
2013-10-31 16:14:30,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:30,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:30,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000003_0 dst=null perm=null
2013-10-31 16:14:31,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0 dst=null perm=null
2013-10-31 16:14:31,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:31,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:31,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000002_0 dst=null perm=null
2013-10-31 16:14:31,074 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:31,076 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000000_0 is done.
2013-10-31 16:14:31,076 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000000_0 was -1
2013-10-31 16:14:31,076 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:31,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0 dst=null perm=null
2013-10-31 16:14:31,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:31,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0/part-00004 dst=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:31,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary/_attempt_20131031160444934_0022_m_000004_0 dst=null perm=null
2013-10-31 16:14:31,424 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0022_m_000006_0
2013-10-31 16:14:31,424 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0022_m_000006_0
2013-10-31 16:14:31,425 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000006_0 not found in cache
2013-10-31 16:14:31,807 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:31,809 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000003_0 is done.
2013-10-31 16:14:31,809 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000003_0 was -1
2013-10-31 16:14:31,810 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:31,833 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:31,835 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000002_0 is done.
2013-10-31 16:14:31,835 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000002_0 was -1
2013-10-31 16:14:31,835 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:32,365 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:32,367 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000004_0 is done.
2013-10-31 16:14:32,367 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000004_0 was -1
2013-10-31 16:14:32,367 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:32,428 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000000_0' has completed task_20131031160444934_0022_m_000000 successfully.
2013-10-31 16:14:32,429 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000001_0' has completed task_20131031160444934_0022_m_000001 successfully.
2013-10-31 16:14:33,112 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000002_0' has completed task_20131031160444934_0022_m_000002 successfully.
2013-10-31 16:14:33,113 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000003_0' has completed task_20131031160444934_0022_m_000003 successfully.
2013-10-31 16:14:33,212 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000004_0' has completed task_20131031160444934_0022_m_000004 successfully.
2013-10-31 16:14:33,215 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0022_m_000005_0' to tip task_20131031160444934_0022_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:33,218 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0022_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:14:33,218 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0022_m_000005_0 which needs 1 slots
2013-10-31 16:14:33,218 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0022_m_000005_0 which needs 1 slots
2013-10-31 16:14:33,246 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0022_m_1713633212
2013-10-31 16:14:33,247 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0022_m_1713633212 spawned.
2013-10-31 16:14:33,250 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0022/attempt_20131031160444934_0022_m_000005_0/taskjvm.sh
2013-10-31 16:14:34,351 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0022_m_1713633212 given task: attempt_20131031160444934_0022_m_000005_0
2013-10-31 16:14:34,845 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000005_0 0.0%
2013-10-31 16:14:34,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_temporary dst=null perm=null
2013-10-31 16:14:34,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:34,866 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_SUCCESS from client DFSClient_attempt_20131031160444934_0022_m_000005_0
2013-10-31 16:14:34,866 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0022_m_000005_0
2013-10-31 16:14:34,870 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3030443344262937130 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5412770078617130947 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4201116548825547386 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4201116548825547386 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,872 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4201116548825547386 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,872 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-249330390446619125 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:34,872 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-249330390446619125 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:34,872 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-249330390446619125 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:34,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0022 dst=null perm=null
2013-10-31 16:14:36,278 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-5412770078617130947_1245 blk_4201116548825547386_1246 blk_3030443344262937130_1244
2013-10-31 16:14:36,278 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-5412770078617130947_1245 blk_-249330390446619125_1247 blk_3030443344262937130_1244
2013-10-31 16:14:36,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data3/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:36,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-249330390446619125_1247 file build/test/data/dfs/data/data4/current/blk_-249330390446619125 for deletion
2013-10-31 16:14:36,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data3/current/blk_-5412770078617130947
2013-10-31 16:14:36,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data4/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:36,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-249330390446619125_1247 at file build/test/data/dfs/data/data4/current/blk_-249330390446619125
2013-10-31 16:14:36,421 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data4/current/blk_3030443344262937130
2013-10-31 16:14:37,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data6/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:37,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data5/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:37,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data6/current/blk_-5412770078617130947
2013-10-31 16:14:37,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4201116548825547386_1246 file build/test/data/dfs/data/data5/current/blk_4201116548825547386 for deletion
2013-10-31 16:14:37,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data5/current/blk_3030443344262937130
2013-10-31 16:14:37,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4201116548825547386_1246 at file build/test/data/dfs/data/data5/current/blk_4201116548825547386
2013-10-31 16:14:37,780 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0022_m_000005_0 0.0% cleanup
2013-10-31 16:14:37,781 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0022_m_000005_0 is done.
2013-10-31 16:14:37,782 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0022_m_000005_0 was -1
2013-10-31 16:14:37,782 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:39,224 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0022_m_000005_0' has completed task_20131031160444934_0022_m_000005 successfully.
2013-10-31 16:14:39,225 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0022 has completed successfully.
2013-10-31 16:14:39,226 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0022,submitTime=1383236059784,launchTime=1383236060312,firstMapTaskLaunchTime=1383236066420,firstJobSetupTaskLaunchTime=1383236060406,firstJobCleanupTaskLaunchTime=1383236073215,finishTime=1383236079225,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5E10CF82AC014665B411915D07D24A73/D543C936A3E14009B56D76795BE5D87E] lower*upper/(2/2)
2013-10-31 16:14:39,231 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009. blk_3293186924092887077_1256
2013-10-31 16:14:39,232 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3293186924092887077_1256 src: /127.0.0.1:55597 dest: /127.0.0.1:41648
2013-10-31 16:14:39,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3293186924092887077_1256 src: /127.0.0.1:35562 dest: /127.0.0.1:38271
2013-10-31 16:14:39,236 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3293186924092887077_1256 src: /127.0.0.1:48596 dest: /127.0.0.1:47311
2013-10-31 16:14:39,240 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48596, dest: /127.0.0.1:47311, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3293186924092887077_1256, duration: 88874
2013-10-31 16:14:39,240 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3293186924092887077_1256 terminating
2013-10-31 16:14:39,240 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35562, dest: /127.0.0.1:38271, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3293186924092887077_1256, duration: 872112
2013-10-31 16:14:39,241 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3293186924092887077_1256 terminating
2013-10-31 16:14:39,241 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55597, dest: /127.0.0.1:41648, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_1306363302, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3293186924092887077_1256, duration: 1798002
2013-10-31 16:14:39,242 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3293186924092887077_1256 terminating
2013-10-31 16:14:39,244 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3293186924092887077_1256 size 26329
2013-10-31 16:14:39,246 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3293186924092887077_1256 size 26329
2013-10-31 16:14:39,247 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009 from client DFSClient_1306363302
2013-10-31 16:14:39,247 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/_logs/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009 is closed by DFSClient_1306363302
2013-10-31 16:14:39,247 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3293186924092887077_1256 size 26329
2013-10-31 16:14:39,279 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-5412770078617130947_1245 blk_-249330390446619125_1247 blk_4201116548825547386_1246 blk_3030443344262937130_1244
2013-10-31 16:14:39,279 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5412770078617130947_1245 blk_-249330390446619125_1247 blk_4201116548825547386_1246 blk_3030443344262937130_1244
2013-10-31 16:14:39,350 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0022_1383236059784_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2FD543C936A3E14009 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:39,351 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000004_0'
2013-10-31 16:14:39,351 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000005_0'
2013-10-31 16:14:39,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5171279128071141564 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:39,353 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:39,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5171279128071141564 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:39,353 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0022 being deleted.
2013-10-31 16:14:39,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5171279128071141564 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:39,356 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0022_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:14:39,356 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2) ...dedpipesplatform/joinself
2013-10-31 16:14:39,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0022 dst=null perm=null
2013-10-31 16:14:39,364 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:14:39,364 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:14:39,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:39,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:14:39,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,386 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar. blk_3929478301678117236_1257
2013-10-31 16:14:39,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:48598 dest: /127.0.0.1:47311
2013-10-31 16:14:39,389 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:35566 dest: /127.0.0.1:38271
2013-10-31 16:14:39,390 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:55603 dest: /127.0.0.1:41648
2013-10-31 16:14:39,400 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55603, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3929478301678117236_1257, duration: 6757973
2013-10-31 16:14:39,401 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3929478301678117236_1257 terminating
2013-10-31 16:14:39,401 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:39,401 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35566, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3929478301678117236_1257, duration: 7638719
2013-10-31 16:14:39,402 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3929478301678117236_1257 terminating
2013-10-31 16:14:39,402 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48598, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3929478301678117236_1257, duration: 8565107
2013-10-31 16:14:39,403 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3929478301678117236_1257 terminating
2013-10-31 16:14:39,404 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:39,405 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar from client DFSClient_1457307213
2013-10-31 16:14:39,405 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar is closed by DFSClient_1457307213
2013-10-31 16:14:39,406 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:39,411 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar. New replication is 10
2013-10-31 16:14:39,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar dst=null perm=null
2013-10-31 16:14:39,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,428 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:14:39,434 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:14:39,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:39,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,449 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split. New replication is 10
2013-10-31 16:14:39,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=null
2013-10-31 16:14:39,458 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split. blk_-9000640118742178060_1258
2013-10-31 16:14:39,460 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:35499 dest: /127.0.0.1:50942
2013-10-31 16:14:39,462 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:35569 dest: /127.0.0.1:38271
2013-10-31 16:14:39,463 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:48603 dest: /127.0.0.1:47311
2013-10-31 16:14:39,465 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9000640118742178060_1258 src: /127.0.0.1:55607 dest: /127.0.0.1:41648
2013-10-31 16:14:39,468 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55607, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9000640118742178060_1258, duration: 1714277
2013-10-31 16:14:39,468 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,468 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,469 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48603, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9000640118742178060_1258, duration: 949802
2013-10-31 16:14:39,469 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,469 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,470 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35569, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9000640118742178060_1258, duration: 1926959
2013-10-31 16:14:39,470 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,471 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35499, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9000640118742178060_1258, duration: 2799646
2013-10-31 16:14:39,472 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-9000640118742178060_1258 terminating
2013-10-31 16:14:39,475 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,475 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split from client DFSClient_1457307213
2013-10-31 16:14:39,476 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split is closed by DFSClient_1457307213
2013-10-31 16:14:39,476 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9000640118742178060_1258 size 1732
2013-10-31 16:14:39,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,495 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo. blk_6037080951287622233_1259
2013-10-31 16:14:39,496 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6037080951287622233_1259 src: /127.0.0.1:35503 dest: /127.0.0.1:50942
2013-10-31 16:14:39,498 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6037080951287622233_1259 src: /127.0.0.1:55609 dest: /127.0.0.1:41648
2013-10-31 16:14:39,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6037080951287622233_1259 src: /127.0.0.1:48607 dest: /127.0.0.1:47311
2013-10-31 16:14:39,502 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48607, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6037080951287622233_1259, duration: 65030
2013-10-31 16:14:39,503 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6037080951287622233_1259 terminating
2013-10-31 16:14:39,503 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55609, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6037080951287622233_1259, duration: 919740
2013-10-31 16:14:39,504 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6037080951287622233_1259 terminating
2013-10-31 16:14:39,504 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6037080951287622233_1259 size 183
2013-10-31 16:14:39,504 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35503, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6037080951287622233_1259, duration: 1724924
2013-10-31 16:14:39,505 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6037080951287622233_1259 terminating
2013-10-31 16:14:39,507 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6037080951287622233_1259 size 183
2013-10-31 16:14:39,507 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:14:39,508 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:14:39,508 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6037080951287622233_1259 size 183
2013-10-31 16:14:39,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:39,536 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml. blk_4802719476021157792_1260
2013-10-31 16:14:39,537 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4802719476021157792_1260 src: /127.0.0.1:48608 dest: /127.0.0.1:47311
2013-10-31 16:14:39,539 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4802719476021157792_1260 src: /127.0.0.1:35507 dest: /127.0.0.1:50942
2013-10-31 16:14:39,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4802719476021157792_1260 src: /127.0.0.1:35577 dest: /127.0.0.1:38271
2013-10-31 16:14:39,544 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35577, dest: /127.0.0.1:38271, bytes: 28509, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 80897
2013-10-31 16:14:39,544 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4802719476021157792_1260 terminating
2013-10-31 16:14:39,544 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35507, dest: /127.0.0.1:50942, bytes: 28509, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4802719476021157792_1260, duration: 845159
2013-10-31 16:14:39,545 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4802719476021157792_1260 terminating
2013-10-31 16:14:39,545 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48608, dest: /127.0.0.1:47311, bytes: 28509, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4802719476021157792_1260, duration: 1681209
2013-10-31 16:14:39,546 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4802719476021157792_1260 size 28509
2013-10-31 16:14:39,546 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4802719476021157792_1260 terminating
2013-10-31 16:14:39,548 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml from client DFSClient_1457307213
2013-10-31 16:14:39,548 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml is closed by DFSClient_1457307213
2013-10-31 16:14:39,548 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4802719476021157792_1260 size 28509
2013-10-31 16:14:39,549 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4802719476021157792_1260 size 28509
2013-10-31 16:14:39,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml dst=null perm=null
2013-10-31 16:14:39,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35579, bytes: 28733, op: HDFS_READ, cliID: DFSClient_2026279523, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 377087
2013-10-31 16:14:39,581 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0023: nMaps=5 nReduces=0 max=-1
2013-10-31 16:14:39,581 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0023 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:14:39,581 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0023 RESULT=SUCCESS
2013-10-31 16:14:39,581 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0023
2013-10-31 16:14:39,582 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0023
2013-10-31 16:14:39,582 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0023
2013-10-31 16:14:39,848 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:14:39,861 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,866 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,872 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,877 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,888 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:14:39,888 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:14:40,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:40,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:40,095 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml. blk_1829214601126488145_1262
2013-10-31 16:14:40,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1829214601126488145_1262 src: /127.0.0.1:35580 dest: /127.0.0.1:38271
2013-10-31 16:14:40,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1829214601126488145_1262 src: /127.0.0.1:48614 dest: /127.0.0.1:47311
2013-10-31 16:14:40,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1829214601126488145_1262 src: /127.0.0.1:55618 dest: /127.0.0.1:41648
2013-10-31 16:14:40,105 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55618, dest: /127.0.0.1:41648, bytes: 28574, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1829214601126488145_1262, duration: 1179714
2013-10-31 16:14:40,105 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1829214601126488145_1262 terminating
2013-10-31 16:14:40,105 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48614, dest: /127.0.0.1:47311, bytes: 28574, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1829214601126488145_1262, duration: 1161559
2013-10-31 16:14:40,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1829214601126488145_1262 terminating
2013-10-31 16:14:40,106 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35580, dest: /127.0.0.1:38271, bytes: 28574, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1829214601126488145_1262, duration: 2066913
2013-10-31 16:14:40,107 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1829214601126488145_1262 terminating
2013-10-31 16:14:40,110 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1829214601126488145_1262 size 28574
2013-10-31 16:14:40,110 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml from client DFSClient_2026279523
2013-10-31 16:14:40,111 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_conf.xml is closed by DFSClient_2026279523
2013-10-31 16:14:40,111 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1829214601126488145_1262 size 28574
2013-10-31 16:14:40,112 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1829214601126488145_1262 size 28574
2013-10-31 16:14:40,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:40,136 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken. blk_973369226213168052_1263
2013-10-31 16:14:40,138 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_973369226213168052_1263 src: /127.0.0.1:48616 dest: /127.0.0.1:47311
2013-10-31 16:14:40,139 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_973369226213168052_1263 src: /127.0.0.1:35515 dest: /127.0.0.1:50942
2013-10-31 16:14:40,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_973369226213168052_1263 src: /127.0.0.1:35585 dest: /127.0.0.1:38271
2013-10-31 16:14:40,144 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35585, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_973369226213168052_1263, duration: 64748
2013-10-31 16:14:40,144 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_973369226213168052_1263 terminating
2013-10-31 16:14:40,144 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35515, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_973369226213168052_1263, duration: 813588
2013-10-31 16:14:40,145 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_973369226213168052_1263 terminating
2013-10-31 16:14:40,145 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48616, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_973369226213168052_1263, duration: 1615069
2013-10-31 16:14:40,146 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_973369226213168052_1263 terminating
2013-10-31 16:14:40,148 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_973369226213168052_1263 size 116
2013-10-31 16:14:40,148 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_973369226213168052_1263 size 116
2013-10-31 16:14:40,149 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken from client DFSClient_1457307213
2013-10-31 16:14:40,149 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken is closed by DFSClient_1457307213
2013-10-31 16:14:40,150 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_973369226213168052_1263 size 116
2013-10-31 16:14:40,159 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken
2013-10-31 16:14:40,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.splitmetainfo dst=null perm=null
2013-10-31 16:14:40,163 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55622, bytes: 187, op: HDFS_READ, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6037080951287622233_1259, duration: 266759
2013-10-31 16:14:40,164 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0023 = 19. Number of splits = 5
2013-10-31 16:14:40,165 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,165 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,165 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,165 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,166 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,167 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0023_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:14:40,168 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0023 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:14:40,169 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0023 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:14:41,449 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0023_m_000006_0' to tip task_20131031160444934_0023_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:41,455 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000000_0'
2013-10-31 16:14:41,455 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000001_0'
2013-10-31 16:14:41,455 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000006_0'
2013-10-31 16:14:41,457 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:14:41,458 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000006_0 which needs 1 slots
2013-10-31 16:14:41,458 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000006_0 which needs 1 slots
2013-10-31 16:14:41,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken dst=null perm=null
2013-10-31 16:14:41,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35587, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_973369226213168052_1263, duration: 373749
2013-10-31 16:14:41,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml dst=null perm=null
2013-10-31 16:14:41,477 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48622, bytes: 28733, op: HDFS_READ, cliID: DFSClient_1722584986, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4802719476021157792_1260, duration: 377698
2013-10-31 16:14:41,503 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:41,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar dst=null perm=null
2013-10-31 16:14:41,516 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48623, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1722584986, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3929478301678117236_1257, duration: 599332
2013-10-31 16:14:41,608 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:41,614 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22840 with signal TERM. Exit code 0
2013-10-31 16:14:41,614 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_188051683
2013-10-31 16:14:41,615 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_188051683 spawned.
2013-10-31 16:14:41,617 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000006_0/taskjvm.sh
2013-10-31 16:14:41,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data1/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:41,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-249330390446619125_1247 file build/test/data/dfs/data/data1/current/blk_-249330390446619125 for deletion
2013-10-31 16:14:41,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data1/current/blk_-5412770078617130947
2013-10-31 16:14:41,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data2/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:41,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-249330390446619125_1247 at file build/test/data/dfs/data/data1/current/blk_-249330390446619125
2013-10-31 16:14:41,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4201116548825547386_1246 file build/test/data/dfs/data/data2/current/blk_4201116548825547386 for deletion
2013-10-31 16:14:41,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data2/current/blk_3030443344262937130
2013-10-31 16:14:41,824 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4201116548825547386_1246 at file build/test/data/dfs/data/data2/current/blk_4201116548825547386
2013-10-31 16:14:42,025 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5412770078617130947_1245 file build/test/data/dfs/data/data7/current/blk_-5412770078617130947 for deletion
2013-10-31 16:14:42,025 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-249330390446619125_1247 file build/test/data/dfs/data/data7/current/blk_-249330390446619125 for deletion
2013-10-31 16:14:42,025 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5412770078617130947_1245 at file build/test/data/dfs/data/data7/current/blk_-5412770078617130947
2013-10-31 16:14:42,025 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3030443344262937130_1244 file build/test/data/dfs/data/data8/current/blk_3030443344262937130 for deletion
2013-10-31 16:14:42,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-249330390446619125_1247 at file build/test/data/dfs/data/data7/current/blk_-249330390446619125
2013-10-31 16:14:42,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4201116548825547386_1246 file build/test/data/dfs/data/data8/current/blk_4201116548825547386 for deletion
2013-10-31 16:14:42,026 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3030443344262937130_1244 at file build/test/data/dfs/data/data8/current/blk_3030443344262937130
2013-10-31 16:14:42,027 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4201116548825547386_1246 at file build/test/data/dfs/data/data8/current/blk_4201116548825547386
2013-10-31 16:14:42,128 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000002_0'
2013-10-31 16:14:42,129 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0022_m_000003_0'
2013-10-31 16:14:42,280 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_3929478301678117236_1257 to datanode(s) 127.0.0.1:50942
2013-10-31 16:14:42,280 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5171279128071141564_1250
2013-10-31 16:14:42,280 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-5171279128071141564_1250
2013-10-31 16:14:42,422 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_3929478301678117236_1257 to 127.0.0.1:50942
2013-10-31 16:14:42,422 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5171279128071141564_1250 file build/test/data/dfs/data/data4/current/blk_-5171279128071141564 for deletion
2013-10-31 16:14:42,423 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5171279128071141564_1250 at file build/test/data/dfs/data/data4/current/blk_-5171279128071141564
2013-10-31 16:14:42,424 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3929478301678117236_1257 src: /127.0.0.1:35522 dest: /127.0.0.1:50942
2013-10-31 16:14:42,424 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_3929478301678117236_1257 to /127.0.0.1:50942
2013-10-31 16:14:42,427 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3929478301678117236_1257 src: /127.0.0.1:35522 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:14:42,429 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3929478301678117236_1257 size 238055
2013-10-31 16:14:42,544 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0022_m_-1610034685
2013-10-31 16:14:42,979 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:42,979 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:42,980 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:42,980 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_-1610034685 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:14:43,613 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_188051683 given task: attempt_20131031160444934_0023_m_000006_0
2013-10-31 16:14:44,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:44,353 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:44,353 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000005_0 not found in cache
2013-10-31 16:14:44,354 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000004_0 not found in cache
2013-10-31 16:14:44,354 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0022 for user-log deletion with retainTimeStamp:1383322484354
2013-10-31 16:14:44,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5171279128071141564_1250 file build/test/data/dfs/data/data1/current/blk_-5171279128071141564 for deletion
2013-10-31 16:14:44,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5171279128071141564_1250 at file build/test/data/dfs/data/data1/current/blk_-5171279128071141564
2013-10-31 16:14:44,941 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_1921536696 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:44,952 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23155 with signal TERM. Exit code 0
2013-10-31 16:14:45,134 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:45,134 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:45,134 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:45,135 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_1921536696 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:45,281 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-5171279128071141564_1250
2013-10-31 16:14:45,845 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_1713633212 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:45,855 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23324 with signal TERM. Exit code 0
2013-10-31 16:14:46,026 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:46,027 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:46,027 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:46,027 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_1713633212 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:46,036 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5171279128071141564_1250 file build/test/data/dfs/data/data5/current/blk_-5171279128071141564 for deletion
2013-10-31 16:14:46,036 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5171279128071141564_1250 at file build/test/data/dfs/data/data5/current/blk_-5171279128071141564
2013-10-31 16:14:46,458 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:46,458 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000001_0 not found in cache
2013-10-31 16:14:46,459 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000000_0 not found in cache
2013-10-31 16:14:46,459 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0022 for user-log deletion with retainTimeStamp:1383322486459
2013-10-31 16:14:46,656 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_-1349535248 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:46,665 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22959 with signal TERM. Exit code 0
2013-10-31 16:14:46,860 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:46,860 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:46,860 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:46,860 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_-1349535248 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:47,031 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000006_0 0.0% setup
2013-10-31 16:14:47,034 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000006_0 is done.
2013-10-31 16:14:47,034 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000006_0 was -1
2013-10-31 16:14:47,035 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:47,129 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0022
2013-10-31 16:14:47,130 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000002_0 not found in cache
2013-10-31 16:14:47,130 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0022_m_000003_0 not found in cache
2013-10-31 16:14:47,131 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0022 for user-log deletion with retainTimeStamp:1383322487131
2013-10-31 16:14:47,384 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_1625766810 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:47,394 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23062 with signal TERM. Exit code 0
2013-10-31 16:14:47,402 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0022_m_-1787526564 since job job_20131031160444934_0022 is dead
2013-10-31 16:14:47,419 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23098 with signal TERM. Exit code 0
2013-10-31 16:14:47,462 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000006_0' has completed task_20131031160444934_0023_m_000006 successfully.
2013-10-31 16:14:47,465 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000000_0' to tip task_20131031160444934_0023_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:47,466 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000000
2013-10-31 16:14:47,466 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000001_0' to tip task_20131031160444934_0023_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:14:47,466 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000001
2013-10-31 16:14:47,467 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:14:47,467 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:14:47,467 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000000_0 which needs 1 slots
2013-10-31 16:14:47,468 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000000_0 which needs 1 slots
2013-10-31 16:14:47,468 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000001_0 which needs 1 slots
2013-10-31 16:14:47,468 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0023_m_000001_0 which needs 1 slots
2013-10-31 16:14:47,486 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_-450470830
2013-10-31 16:14:47,487 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_-450470830 spawned.
2013-10-31 16:14:47,487 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0023/attempt_20131031160444934_0023_m_000001_0. Attempting to reuse: jvm_20131031160444934_0023_m_188051683
2013-10-31 16:14:47,488 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000000_0/taskjvm.sh
2013-10-31 16:14:47,590 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_188051683 given task: attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:47,624 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:47,624 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:47,624 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:47,624 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:14:47,624 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_1625766810 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:47,624 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:14:47,624 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:14:47,624 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0022_m_-1787526564 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:14:47,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=null
2013-10-31 16:14:47,709 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48628, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9000640118742178060_1258, duration: 174405
2013-10-31 16:14:47,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:47,749 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35596, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 124730
2013-10-31 16:14:47,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:47,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:48,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=null
2013-10-31 16:14:48,009 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 9
2013-10-31 16:14:48,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:48,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:48,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:48,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:48,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:48,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:48,023 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35597, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6836394959299064328_1252, duration: 126669
2013-10-31 16:14:48,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:48,038 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55634, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7071146985674685312_1251, duration: 99242
2013-10-31 16:14:48,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:48,041 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35530, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 98091
2013-10-31 16:14:48,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:48,044 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35600, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4171475749075851274_1253, duration: 98655
2013-10-31 16:14:48,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:48,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55637, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6147278667197761988_1255, duration: 97349
2013-10-31 16:14:48,054 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001. blk_-2116960668324569547_1264
2013-10-31 16:14:48,069 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2116960668324569547_1264 src: /127.0.0.1:48635 dest: /127.0.0.1:47311
2013-10-31 16:14:48,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2116960668324569547_1264 src: /127.0.0.1:35534 dest: /127.0.0.1:50942
2013-10-31 16:14:48,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2116960668324569547_1264 src: /127.0.0.1:55640 dest: /127.0.0.1:41648
2013-10-31 16:14:48,073 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55640, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2116960668324569547_1264, duration: 1291954
2013-10-31 16:14:48,074 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2116960668324569547_1264 terminating
2013-10-31 16:14:48,074 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35534, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2116960668324569547_1264, duration: 1668750
2013-10-31 16:14:48,074 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2116960668324569547_1264 terminating
2013-10-31 16:14:48,074 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48635, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2116960668324569547_1264, duration: 2125147
2013-10-31 16:14:48,075 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2116960668324569547_1264 terminating
2013-10-31 16:14:48,075 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2116960668324569547_1264 size 8
2013-10-31 16:14:48,076 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:48,076 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:48,077 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2116960668324569547_1264 size 8
2013-10-31 16:14:48,078 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2116960668324569547_1264 size 8
2013-10-31 16:14:48,112 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:48,113 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000001_0 0.0%
2013-10-31 16:14:48,135 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000002_0' to tip task_20131031160444934_0023_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:48,135 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000002
2013-10-31 16:14:48,135 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000003_0' to tip task_20131031160444934_0023_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:14:48,136 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000003
2013-10-31 16:14:48,137 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:14:48,137 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:14:48,137 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000002_0 which needs 1 slots
2013-10-31 16:14:48,137 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000002_0 which needs 1 slots
2013-10-31 16:14:48,137 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000003_0 which needs 1 slots
2013-10-31 16:14:48,138 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0023_m_000003_0 which needs 1 slots
2013-10-31 16:14:48,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken dst=null perm=null
2013-10-31 16:14:48,141 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48638, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_973369226213168052_1263, duration: 174925
2013-10-31 16:14:48,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml dst=null perm=null
2013-10-31 16:14:48,147 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35607, bytes: 28733, op: HDFS_READ, cliID: DFSClient_1952345195, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 220481
2013-10-31 16:14:48,163 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:48,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar dst=null perm=null
2013-10-31 16:14:48,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55644, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1952345195, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3929478301678117236_1257, duration: 604051
2013-10-31 16:14:48,228 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_1264514395
2013-10-31 16:14:48,228 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_1264514395 spawned.
2013-10-31 16:14:48,228 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_-1577082009
2013-10-31 16:14:48,229 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_-1577082009 spawned.
2013-10-31 16:14:48,230 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000002_0/taskjvm.sh
2013-10-31 16:14:48,230 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000003_0/taskjvm.sh
2013-10-31 16:14:48,361 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0023_m_000004_0' to tip task_20131031160444934_0023_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:48,362 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0023_m_000004
2013-10-31 16:14:48,363 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:14:48,363 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000004_0 which needs 1 slots
2013-10-31 16:14:48,363 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000004_0 which needs 1 slots
2013-10-31 16:14:48,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023/jobToken dst=null perm=null
2013-10-31 16:14:48,368 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48643, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_973369226213168052_1263, duration: 129809
2013-10-31 16:14:48,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.xml dst=null perm=null
2013-10-31 16:14:48,374 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35612, bytes: 28733, op: HDFS_READ, cliID: DFSClient_-1036874446, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4802719476021157792_1260, duration: 158067
2013-10-31 16:14:48,387 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_-450470830 given task: attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:48,387 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:14:48,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.jar dst=null perm=null
2013-10-31 16:14:48,401 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48646, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1036874446, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3929478301678117236_1257, duration: 635151
2013-10-31 16:14:48,820 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_-388264292
2013-10-31 16:14:48,821 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_-388264292 spawned.
2013-10-31 16:14:48,822 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000004_0/taskjvm.sh
2013-10-31 16:14:49,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=null
2013-10-31 16:14:49,265 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35546, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9000640118742178060_1258, duration: 161645
2013-10-31 16:14:49,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:49,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:49,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:49,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=null
2013-10-31 16:14:49,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:49,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:49,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:49,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:49,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:49,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:49,543 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48650, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6836394959299064328_1252, duration: 137905
2013-10-31 16:14:49,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:49,561 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48651, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7071146985674685312_1251, duration: 124681
2013-10-31 16:14:49,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:49,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48652, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5893390770057608854_1255, duration: 119922
2013-10-31 16:14:49,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:49,567 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35620, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4171475749075851274_1253, duration: 103782
2013-10-31 16:14:49,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:49,570 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35552, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6147278667197761988_1255, duration: 106037
2013-10-31 16:14:49,573 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35622, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 103582
2013-10-31 16:14:49,580 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000. blk_3615276268400455558_1265
2013-10-31 16:14:49,602 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3615276268400455558_1265 src: /127.0.0.1:48656 dest: /127.0.0.1:47311
2013-10-31 16:14:49,603 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3615276268400455558_1265 src: /127.0.0.1:35624 dest: /127.0.0.1:38271
2013-10-31 16:14:49,604 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3615276268400455558_1265 src: /127.0.0.1:55661 dest: /127.0.0.1:41648
2013-10-31 16:14:49,606 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55661, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3615276268400455558_1265, duration: 1305864
2013-10-31 16:14:49,606 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3615276268400455558_1265 terminating
2013-10-31 16:14:49,607 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35624, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3615276268400455558_1265, duration: 1433145
2013-10-31 16:14:49,607 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3615276268400455558_1265 terminating
2013-10-31 16:14:49,607 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48656, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3615276268400455558_1265, duration: 1948826
2013-10-31 16:14:49,607 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3615276268400455558_1265 terminating
2013-10-31 16:14:49,607 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3615276268400455558_1265 size 8
2013-10-31 16:14:49,608 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_1264514395 given task: attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:49,608 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:49,609 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:49,610 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3615276268400455558_1265 size 8
2013-10-31 16:14:49,611 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3615276268400455558_1265 size 8
2013-10-31 16:14:49,655 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:49,655 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000000_0 0.0%
2013-10-31 16:14:50,015 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_-1577082009 given task: attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:50,016 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_-388264292 given task: attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:50,098 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:14:50,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=null
2013-10-31 16:14:50,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55665, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9000640118742178060_1258, duration: 169044
2013-10-31 16:14:50,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:50,144 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48663, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 164372
2013-10-31 16:14:50,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:50,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:50,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=null
2013-10-31 16:14:50,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:50,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:50,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:50,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:50,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:50,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:50,391 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35631, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6836394959299064328_1252, duration: 129520
2013-10-31 16:14:50,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:50,408 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48665, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7071146985674685312_1251, duration: 104193
2013-10-31 16:14:50,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:50,411 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35564, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 100712
2013-10-31 16:14:50,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:50,414 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35565, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4171475749075851274_1253, duration: 102638
2013-10-31 16:14:50,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:50,417 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55671, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6147278667197761988_1255, duration: 100898
2013-10-31 16:14:50,425 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002. blk_3089639079467808328_1266
2013-10-31 16:14:50,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3089639079467808328_1266 src: /127.0.0.1:48669 dest: /127.0.0.1:47311
2013-10-31 16:14:50,450 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3089639079467808328_1266 src: /127.0.0.1:55675 dest: /127.0.0.1:41648
2013-10-31 16:14:50,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3089639079467808328_1266 src: /127.0.0.1:35571 dest: /127.0.0.1:50942
2013-10-31 16:14:50,453 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35571, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3089639079467808328_1266, duration: 1313560
2013-10-31 16:14:50,453 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3089639079467808328_1266 terminating
2013-10-31 16:14:50,453 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3089639079467808328_1266 size 8
2013-10-31 16:14:50,453 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55675, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3089639079467808328_1266, duration: 1475188
2013-10-31 16:14:50,453 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3089639079467808328_1266 size 8
2013-10-31 16:14:50,453 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3089639079467808328_1266 terminating
2013-10-31 16:14:50,453 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48669, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3089639079467808328_1266, duration: 1933155
2013-10-31 16:14:50,454 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3089639079467808328_1266 size 8
2013-10-31 16:14:50,454 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3089639079467808328_1266 terminating
2013-10-31 16:14:50,455 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:50,455 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:50,470 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000000_0
2013-10-31 16:14:50,470 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000001_0
2013-10-31 16:14:50,505 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:50,505 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000002_0 0.0%
2013-10-31 16:14:50,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=null
2013-10-31 16:14:50,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023/job.split dst=null perm=null
2013-10-31 16:14:50,514 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48674, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9000640118742178060_1258, duration: 200359
2013-10-31 16:14:50,521 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55678, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9000640118742178060_1258, duration: 229361
2013-10-31 16:14:50,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:50,555 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48676, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 102695
2013-10-31 16:14:50,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:14:50,562 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35644, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 228607
2013-10-31 16:14:50,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0 dst=null perm=null
2013-10-31 16:14:50,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0 dst=null perm=null
2013-10-31 16:14:51,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,142 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000002_0
2013-10-31 16:14:51,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000001_0 dst=null perm=null
2013-10-31 16:14:51,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000000_0 dst=null perm=null
2013-10-31 16:14:51,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0 dst=null perm=null
2013-10-31 16:14:51,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:51,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:51,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000002_0 dst=null perm=null
2013-10-31 16:14:51,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=null
2013-10-31 16:14:51,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:51,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=null
2013-10-31 16:14:51,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:51,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:51,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:51,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:51,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:51,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:51,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:51,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:51,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:51,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:51,638 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48678, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6836394959299064328_1252, duration: 124751
2013-10-31 16:14:51,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00000 dst=null perm=null
2013-10-31 16:14:51,644 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55682, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6836394959299064328_1252, duration: 130061
2013-10-31 16:14:51,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:51,654 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35647, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7071146985674685312_1251, duration: 102538
2013-10-31 16:14:51,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:51,657 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48681, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5893390770057608854_1255, duration: 98567
2013-10-31 16:14:51,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00001 dst=null perm=null
2013-10-31 16:14:51,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:51,661 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35649, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7071146985674685312_1251, duration: 102614
2013-10-31 16:14:51,661 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48683, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4171475749075851274_1253, duration: 111093
2013-10-31 16:14:51,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00002 dst=null perm=null
2013-10-31 16:14:51,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:51,664 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35582, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5893390770057608854_1255, duration: 98451
2013-10-31 16:14:51,664 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35583, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6147278667197761988_1255, duration: 107895
2013-10-31 16:14:51,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00003 dst=null perm=null
2013-10-31 16:14:51,667 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35584, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4171475749075851274_1253, duration: 121749
2013-10-31 16:14:51,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C/part-00004 dst=null perm=null
2013-10-31 16:14:51,670 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35654, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6147278667197761988_1255, duration: 101061
2013-10-31 16:14:51,673 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004. blk_-5360327896194444992_1268
2013-10-31 16:14:51,678 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003. blk_-1592307919191127708_1268
2013-10-31 16:14:51,695 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5360327896194444992_1268 src: /127.0.0.1:48688 dest: /127.0.0.1:47311
2013-10-31 16:14:51,696 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5360327896194444992_1268 src: /127.0.0.1:35588 dest: /127.0.0.1:50942
2013-10-31 16:14:51,697 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5360327896194444992_1268 src: /127.0.0.1:35658 dest: /127.0.0.1:38271
2013-10-31 16:14:51,699 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35658, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5360327896194444992_1268, duration: 1054943
2013-10-31 16:14:51,699 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5360327896194444992_1268 terminating
2013-10-31 16:14:51,699 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5360327896194444992_1268 size 8
2013-10-31 16:14:51,699 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35588, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5360327896194444992_1268, duration: 1412992
2013-10-31 16:14:51,700 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5360327896194444992_1268 size 8
2013-10-31 16:14:51,700 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5360327896194444992_1268 terminating
2013-10-31 16:14:51,700 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48688, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5360327896194444992_1268, duration: 1888486
2013-10-31 16:14:51,700 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1592307919191127708_1268 src: /127.0.0.1:35656 dest: /127.0.0.1:38271
2013-10-31 16:14:51,700 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5360327896194444992_1268 terminating
2013-10-31 16:14:51,702 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:51,702 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1592307919191127708_1268 src: /127.0.0.1:48692 dest: /127.0.0.1:47311
2013-10-31 16:14:51,702 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:51,702 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5360327896194444992_1268 size 8
2013-10-31 16:14:51,703 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1592307919191127708_1268 src: /127.0.0.1:55696 dest: /127.0.0.1:41648
2013-10-31 16:14:51,706 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55696, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1592307919191127708_1268, duration: 1631262
2013-10-31 16:14:51,707 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1592307919191127708_1268 terminating
2013-10-31 16:14:51,707 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48692, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1592307919191127708_1268, duration: 1553836
2013-10-31 16:14:51,708 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1592307919191127708_1268 terminating
2013-10-31 16:14:51,708 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35656, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0023_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1592307919191127708_1268, duration: 2622923
2013-10-31 16:14:51,708 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1592307919191127708_1268 terminating
2013-10-31 16:14:51,709 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1592307919191127708_1268 size 8
2013-10-31 16:14:51,710 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:51,710 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:51,710 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1592307919191127708_1268 size 8
2013-10-31 16:14:51,711 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1592307919191127708_1268 size 8
2013-10-31 16:14:51,772 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:51,772 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0023_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:14:51,772 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000004_0 0.0%
2013-10-31 16:14:51,772 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000003_0 0.0%
2013-10-31 16:14:51,825 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:14:51,827 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000000_0 is done.
2013-10-31 16:14:51,827 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000000_0 was -1
2013-10-31 16:14:51,828 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:52,468 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0023_m_000006_0
2013-10-31 16:14:52,468 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0023_m_000006_0
2013-10-31 16:14:52,468 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000006_0 not found in cache
2013-10-31 16:14:53,027 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:14:53,029 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000002_0 is done.
2013-10-31 16:14:53,029 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000002_0 was -1
2013-10-31 16:14:53,030 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:14:53,474 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000000_0' has completed task_20131031160444934_0023_m_000000 successfully.
2013-10-31 16:14:53,722 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:53,725 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:14:53,727 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000001_0 is done.
2013-10-31 16:14:53,727 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000001_0 was -1
2013-10-31 16:14:53,727 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:54,145 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000002_0' has completed task_20131031160444934_0023_m_000002 successfully.
2013-10-31 16:14:54,147 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000003_0
2013-10-31 16:14:54,369 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0023_m_000004_0
2013-10-31 16:14:54,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0 dst=null perm=null
2013-10-31 16:14:54,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0 dst=null perm=null
2013-10-31 16:14:54,788 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1426 Total time for transactions(ms): 31Number of transactions batched in Syncs: 150 Number of syncs: 1020 SyncTimes(ms): 45643 8539
2013-10-31 16:14:54,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:54,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:14:54,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:54,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:54,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000004_0 dst=null perm=null
2013-10-31 16:14:54,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary/_attempt_20131031160444934_0023_m_000003_0 dst=null perm=null
2013-10-31 16:14:56,480 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000001_0' has completed task_20131031160444934_0023_m_000001 successfully.
2013-10-31 16:14:56,501 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:56,510 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:14:56,511 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000003_0 is done.
2013-10-31 16:14:56,511 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000003_0 was -1
2013-10-31 16:14:56,511 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:56,515 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:56,522 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:14:56,522 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000004_0 is done.
2013-10-31 16:14:56,523 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000004_0 was -1
2013-10-31 16:14:56,523 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:14:57,151 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000003_0' has completed task_20131031160444934_0023_m_000003 successfully.
2013-10-31 16:14:57,373 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000004_0' has completed task_20131031160444934_0023_m_000004 successfully.
2013-10-31 16:14:57,375 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0023_m_000005_0' to tip task_20131031160444934_0023_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:14:57,377 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0023_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:14:57,378 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0023_m_000005_0 which needs 1 slots
2013-10-31 16:14:57,378 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0023_m_000005_0 which needs 1 slots
2013-10-31 16:14:57,408 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0023_m_1581669948
2013-10-31 16:14:57,409 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0023_m_1581669948 spawned.
2013-10-31 16:14:57,411 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0023/attempt_20131031160444934_0023_m_000005_0/taskjvm.sh
2013-10-31 16:14:58,251 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0023_m_1581669948 given task: attempt_20131031160444934_0023_m_000005_0
2013-10-31 16:14:58,767 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000005_0 0.0%
2013-10-31 16:14:59,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary dst=null perm=null
2013-10-31 16:14:59,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:14:59,084 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_SUCCESS from client DFSClient_attempt_20131031160444934_0023_m_000005_0
2013-10-31 16:14:59,085 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0023_m_000005_0
2013-10-31 16:14:59,091 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:59,092 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:59,092 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,092 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3929478301678117236 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,092 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:59,092 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,093 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:59,093 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9000640118742178060 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,093 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6037080951287622233 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:14:59,093 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6037080951287622233 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,094 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6037080951287622233 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,094 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4802719476021157792 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:14:59,094 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4802719476021157792 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:14:59,094 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4802719476021157792 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:14:59,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0023 dst=null perm=null
2013-10-31 16:15:00,284 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_4802719476021157792_1260 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:00,284 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_4802719476021157792_1260 blk_6037080951287622233_1259 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:01,700 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0023_m_000005_0 0.0% cleanup
2013-10-31 16:15:01,701 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0023_m_000005_0 is done.
2013-10-31 16:15:01,702 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0023_m_000005_0 was -1
2013-10-31 16:15:01,702 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:02,829 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data2/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:02,829 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data1/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:02,830 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data2/current/blk_-9000640118742178060
2013-10-31 16:15:02,830 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4802719476021157792_1260 file build/test/data/dfs/data/data1/current/blk_4802719476021157792 for deletion
2013-10-31 16:15:02,830 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data1/current/blk_3929478301678117236
2013-10-31 16:15:02,831 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4802719476021157792_1260 at file build/test/data/dfs/data/data1/current/blk_4802719476021157792
2013-10-31 16:15:03,032 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data7/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:03,032 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data7/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:03,032 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data7/current/blk_-9000640118742178060
2013-10-31 16:15:03,032 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4802719476021157792_1260 file build/test/data/dfs/data/data7/current/blk_4802719476021157792 for deletion
2013-10-31 16:15:03,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data7/current/blk_3929478301678117236
2013-10-31 16:15:03,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6037080951287622233_1259 file build/test/data/dfs/data/data8/current/blk_6037080951287622233 for deletion
2013-10-31 16:15:03,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4802719476021157792_1260 at file build/test/data/dfs/data/data7/current/blk_4802719476021157792
2013-10-31 16:15:03,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6037080951287622233_1259 at file build/test/data/dfs/data/data8/current/blk_6037080951287622233
2013-10-31 16:15:03,284 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_6037080951287622233_1259 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:03,285 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_4802719476021157792_1260 blk_6037080951287622233_1259 blk_-9000640118742178060_1258 blk_3929478301678117236_1257
2013-10-31 16:15:03,383 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0023_m_000005_0' has completed task_20131031160444934_0023_m_000005 successfully.
2013-10-31 16:15:03,384 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0023 has completed successfully.
2013-10-31 16:15:03,385 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0023,submitTime=1383236079555,launchTime=1383236080168,firstMapTaskLaunchTime=1383236087465,firstJobSetupTaskLaunchTime=1383236081448,firstJobCleanupTaskLaunchTime=1383236097375,finishTime=1383236103384,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=41,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5E10CF82AC014665B411915D07D24A73/1E6B46BCFD1C4802A1538AFB49E097CB] lower*upper/(1/2) ...dedpipesplatform/joinself
2013-10-31 16:15:03,390 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802. blk_-4230721372272409284_1269
2013-10-31 16:15:03,391 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230721372272409284_1269 src: /127.0.0.1:35666 dest: /127.0.0.1:38271
2013-10-31 16:15:03,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230721372272409284_1269 src: /127.0.0.1:48700 dest: /127.0.0.1:47311
2013-10-31 16:15:03,398 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4230721372272409284_1269 src: /127.0.0.1:35599 dest: /127.0.0.1:50942
2013-10-31 16:15:03,410 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35599, dest: /127.0.0.1:50942, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4230721372272409284_1269, duration: 7633540
2013-10-31 16:15:03,410 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4230721372272409284_1269 terminating
2013-10-31 16:15:03,411 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4230721372272409284_1269 size 26341
2013-10-31 16:15:03,411 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48700, dest: /127.0.0.1:47311, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4230721372272409284_1269, duration: 8444595
2013-10-31 16:15:03,411 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4230721372272409284_1269 terminating
2013-10-31 16:15:03,412 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35666, dest: /127.0.0.1:38271, bytes: 26341, op: HDFS_WRITE, cliID: DFSClient_2026279523, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4230721372272409284_1269, duration: 7703282
2013-10-31 16:15:03,412 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4230721372272409284_1269 terminating
2013-10-31 16:15:03,417 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4230721372272409284_1269 size 26341
2013-10-31 16:15:03,418 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802 from client DFSClient_2026279523
2013-10-31 16:15:03,418 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_logs/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802 is closed by DFSClient_2026279523
2013-10-31 16:15:03,418 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4230721372272409284_1269 size 26341
2013-10-31 16:15:03,425 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0023_1383236079555_hadoop_%5B5E10CF82AC014665B411915D07D24A73%2F1E6B46BCFD1C4802 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:03,426 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000004_0'
2013-10-31 16:15:03,426 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000005_0'
2013-10-31 16:15:03,428 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_973369226213168052 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,428 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_973369226213168052 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,428 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_973369226213168052 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,429 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data3/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:03,429 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data4/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:03,430 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data3/current/blk_-9000640118742178060
2013-10-31 16:15:03,430 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4802719476021157792_1260 file build/test/data/dfs/data/data3/current/blk_4802719476021157792 for deletion
2013-10-31 16:15:03,430 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data4/current/blk_3929478301678117236
2013-10-31 16:15:03,430 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6037080951287622233_1259 file build/test/data/dfs/data/data4/current/blk_6037080951287622233 for deletion
2013-10-31 16:15:03,430 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4802719476021157792_1260 at file build/test/data/dfs/data/data3/current/blk_4802719476021157792
2013-10-31 16:15:03,431 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6037080951287622233_1259 at file build/test/data/dfs/data/data4/current/blk_6037080951287622233
2013-10-31 16:15:03,431 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0023_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:03,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3293186924092887077 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3293186924092887077 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3293186924092887077 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,434 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_494178843268810844 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_494178843268810844 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_494178843268810844 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6836394959299064328 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,435 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6836394959299064328 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,436 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6836394959299064328 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,436 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7071146985674685312 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,436 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7071146985674685312 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,436 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7071146985674685312 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,437 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5893390770057608854 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,437 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5893390770057608854 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,437 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5893390770057608854 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,437 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4171475749075851274 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,438 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4171475749075851274 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:03,438 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4171475749075851274 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,438 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6147278667197761988 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:03,439 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6147278667197761988 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:03,439 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6147278667197761988 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:03,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0023 dst=null perm=null
2013-10-31 16:15:03,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2746047444_upper_FFFAD5CDD1364FC08ABAADE059F5828C dst=null perm=null
2013-10-31 16:15:03,447 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/_temporary
2013-10-31 16:15:03,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=null
2013-10-31 16:15:03,468 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:03,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2013-10-31 16:15:03,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2013-10-31 16:15:03,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2013-10-31 16:15:03,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2013-10-31 16:15:03,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2013-10-31 16:15:03,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2013-10-31 16:15:03,479 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55706, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3615276268400455558_1265, duration: 271804
2013-10-31 16:15:03,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2013-10-31 16:15:03,482 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35602, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2116960668324569547_1264, duration: 252400
2013-10-31 16:15:03,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2013-10-31 16:15:03,485 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35603, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3089639079467808328_1266, duration: 252193
2013-10-31 16:15:03,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2013-10-31 16:15:03,488 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55709, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1592307919191127708_1268, duration: 250870
2013-10-31 16:15:03,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2013-10-31 16:15:03,491 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35605, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5360327896194444992_1268, duration: 250074
2013-10-31 16:15:03,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=null
2013-10-31 16:15:03,509 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:03,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2013-10-31 16:15:03,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2013-10-31 16:15:03,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2013-10-31 16:15:03,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2013-10-31 16:15:03,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2013-10-31 16:15:03,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2013-10-31 16:15:03,520 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35675, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3615276268400455558_1265, duration: 313224
2013-10-31 16:15:03,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2013-10-31 16:15:03,523 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35607, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2116960668324569547_1264, duration: 265304
2013-10-31 16:15:03,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2013-10-31 16:15:03,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48710, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3089639079467808328_1266, duration: 337978
2013-10-31 16:15:03,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2013-10-31 16:15:03,530 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48711, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1592307919191127708_1268, duration: 251465
2013-10-31 16:15:03,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2013-10-31 16:15:03,533 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35610, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5360327896194444992_1268, duration: 251511
2013-10-31 16:15:03,533 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinself
2013-10-31 16:15:03,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself dst=null perm=null
2013-10-31 16:15:03,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2013-10-31 16:15:03,541 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48713, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3615276268400455558_1265, duration: 256026
2013-10-31 16:15:03,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2013-10-31 16:15:03,545 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55717, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2116960668324569547_1264, duration: 260327
2013-10-31 16:15:03,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2013-10-31 16:15:03,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35613, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3089639079467808328_1266, duration: 261105
2013-10-31 16:15:03,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2013-10-31 16:15:03,550 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48716, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1592307919191127708_1268, duration: 265369
2013-10-31 16:15:03,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2013-10-31 16:15:03,553 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35684, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5360327896194444992_1268, duration: 255520
2013-10-31 16:15:03,562 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:15:03,563 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:15:03,594 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] starting
2013-10-31 16:15:03,595 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:15:03,595 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:15:03,595 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:15:03,596 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped"]
2013-10-31 16:15:03,596 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] parallel execution is enabled: true
2013-10-31 16:15:03,596 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] starting jobs: 2
2013-10-31 16:15:03,596 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [upper2*lower*upper1] allocating threads: 2
2013-10-31 16:15:03,598 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] starting step: (2/2)
2013-10-31 16:15:03,602 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:15:03,602 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:15:03,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:03,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:15:03,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:03,624 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar. blk_8544072883402237301_1270
2013-10-31 16:15:03,625 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:48718 dest: /127.0.0.1:47311
2013-10-31 16:15:03,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:35686 dest: /127.0.0.1:38271
2013-10-31 16:15:03,628 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:35618 dest: /127.0.0.1:50942
2013-10-31 16:15:03,636 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35618, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8544072883402237301_1270, duration: 7021964
2013-10-31 16:15:03,636 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8544072883402237301_1270 terminating
2013-10-31 16:15:03,636 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35686, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8544072883402237301_1270, duration: 6227868
2013-10-31 16:15:03,636 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8544072883402237301_1270 terminating
2013-10-31 16:15:03,637 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48718, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8544072883402237301_1270, duration: 6727754
2013-10-31 16:15:03,637 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8544072883402237301_1270 terminating
2013-10-31 16:15:03,639 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:03,640 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:03,641 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:04,039 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar from client DFSClient_1457307213
2013-10-31 16:15:04,039 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar is closed by DFSClient_1457307213
2013-10-31 16:15:04,042 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9000640118742178060_1258 file build/test/data/dfs/data/data5/current/blk_-9000640118742178060 for deletion
2013-10-31 16:15:04,042 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3929478301678117236_1257 file build/test/data/dfs/data/data6/current/blk_3929478301678117236 for deletion
2013-10-31 16:15:04,042 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9000640118742178060_1258 at file build/test/data/dfs/data/data5/current/blk_-9000640118742178060
2013-10-31 16:15:04,042 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6037080951287622233_1259 file build/test/data/dfs/data/data6/current/blk_6037080951287622233 for deletion
2013-10-31 16:15:04,043 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3929478301678117236_1257 at file build/test/data/dfs/data/data6/current/blk_3929478301678117236
2013-10-31 16:15:04,043 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6037080951287622233_1259 at file build/test/data/dfs/data/data6/current/blk_6037080951287622233
2013-10-31 16:15:04,044 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar. New replication is 10
2013-10-31 16:15:04,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar dst=null perm=null
2013-10-31 16:15:04,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,054 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:15:04,059 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:15:04,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:15:04,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,072 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split. New replication is 10
2013-10-31 16:15:04,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=null
2013-10-31 16:15:04,385 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split. blk_2440796546292724629_1271
2013-10-31 16:15:04,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:48721 dest: /127.0.0.1:47311
2013-10-31 16:15:04,389 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:35620 dest: /127.0.0.1:50942
2013-10-31 16:15:04,390 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:55726 dest: /127.0.0.1:41648
2013-10-31 16:15:04,392 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2440796546292724629_1271 src: /127.0.0.1:35691 dest: /127.0.0.1:38271
2013-10-31 16:15:04,456 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35691, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2440796546292724629_1271, duration: 88347
2013-10-31 16:15:04,456 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,457 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,457 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55726, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2440796546292724629_1271, duration: 882376
2013-10-31 16:15:04,457 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,458 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,458 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35620, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2440796546292724629_1271, duration: 2033271
2013-10-31 16:15:04,458 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,458 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,459 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48721, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2440796546292724629_1271, duration: 2904368
2013-10-31 16:15:04,459 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2440796546292724629_1271 terminating
2013-10-31 16:15:04,461 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split from client DFSClient_1457307213
2013-10-31 16:15:04,462 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split is closed by DFSClient_1457307213
2013-10-31 16:15:04,463 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2440796546292724629_1271 size 1732
2013-10-31 16:15:04,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:04,483 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo. blk_-9086653742670772437_1272
2013-10-31 16:15:04,485 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9086653742670772437_1272 src: /127.0.0.1:35692 dest: /127.0.0.1:38271
2013-10-31 16:15:04,486 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9086653742670772437_1272 src: /127.0.0.1:55729 dest: /127.0.0.1:41648
2013-10-31 16:15:04,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9086653742670772437_1272 src: /127.0.0.1:48727 dest: /127.0.0.1:47311
2013-10-31 16:15:04,490 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48727, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-9086653742670772437_1272, duration: 61123
2013-10-31 16:15:04,490 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9086653742670772437_1272 terminating
2013-10-31 16:15:04,490 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55729, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9086653742670772437_1272, duration: 820457
2013-10-31 16:15:04,491 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9086653742670772437_1272 size 183
2013-10-31 16:15:04,491 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9086653742670772437_1272 terminating
2013-10-31 16:15:04,491 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35692, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9086653742670772437_1272, duration: 1926318
2013-10-31 16:15:04,492 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-9086653742670772437_1272 size 183
2013-10-31 16:15:04,492 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9086653742670772437_1272 terminating
2013-10-31 16:15:04,494 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:15:04,495 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:15:04,495 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9086653742670772437_1272 size 183
2013-10-31 16:15:04,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:05,948 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000000_0'
2013-10-31 16:15:05,949 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000001_0'
2013-10-31 16:15:05,949 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000006_0'
2013-10-31 16:15:06,161 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000002_0'
2013-10-31 16:15:06,161 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0023_m_000003_0'
2013-10-31 16:15:06,285 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_8544072883402237301_1270 to datanode(s) 127.0.0.1:41648
2013-10-31 16:15:06,286 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_973369226213168052_1263 blk_5893390770057608854_1255 blk_4171475749075851274_1253 blk_-6147278667197761988_1255
2013-10-31 16:15:06,286 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_494178843268810844_1249 blk_973369226213168052_1263 blk_5893390770057608854_1255 blk_6836394959299064328_1252 blk_4171475749075851274_1253 blk_-6147278667197761988_1255 blk_7071146985674685312_1251 blk_3293186924092887077_1256
2013-10-31 16:15:06,380 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:06,380 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0023 being deleted.
2013-10-31 16:15:06,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,741 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml. blk_-1379367158697454854_1273
2013-10-31 16:15:06,742 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1379367158697454854_1273 src: /127.0.0.1:35697 dest: /127.0.0.1:38271
2013-10-31 16:15:06,742 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1379367158697454854_1273 src: /127.0.0.1:48731 dest: /127.0.0.1:47311
2013-10-31 16:15:06,743 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1379367158697454854_1273 src: /127.0.0.1:55735 dest: /127.0.0.1:41648
2013-10-31 16:15:06,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55735, dest: /127.0.0.1:41648, bytes: 28563, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1379367158697454854_1273, duration: 112793
2013-10-31 16:15:06,745 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1379367158697454854_1273 terminating
2013-10-31 16:15:06,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48731, dest: /127.0.0.1:47311, bytes: 28563, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1379367158697454854_1273, duration: 474050
2013-10-31 16:15:06,745 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1379367158697454854_1273 terminating
2013-10-31 16:15:06,746 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35697, dest: /127.0.0.1:38271, bytes: 28563, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1379367158697454854_1273, duration: 976111
2013-10-31 16:15:06,746 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1379367158697454854_1273 terminating
2013-10-31 16:15:06,747 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1379367158697454854_1273 size 28563
2013-10-31 16:15:06,747 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml from client DFSClient_1457307213
2013-10-31 16:15:06,748 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml is closed by DFSClient_1457307213
2013-10-31 16:15:06,748 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1379367158697454854_1273 size 28563
2013-10-31 16:15:06,748 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1379367158697454854_1273 size 28563
2013-10-31 16:15:06,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml dst=null perm=null
2013-10-31 16:15:06,756 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35701, bytes: 28787, op: HDFS_READ, cliID: DFSClient_708454635, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1379367158697454854_1273, duration: 172963
2013-10-31 16:15:06,764 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0024: nMaps=5 nReduces=0 max=-1
2013-10-31 16:15:06,764 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0024 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:15:06,764 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0024
2013-10-31 16:15:06,764 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0024 RESULT=SUCCESS
2013-10-31 16:15:06,764 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0024
2013-10-31 16:15:06,765 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] submitted hadoop job: job_20131031160444934_0024
2013-10-31 16:15:06,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,784 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml. blk_8206799160724257515_1275
2013-10-31 16:15:06,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8206799160724257515_1275 src: /127.0.0.1:48735 dest: /127.0.0.1:47311
2013-10-31 16:15:06,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8206799160724257515_1275 src: /127.0.0.1:35634 dest: /127.0.0.1:50942
2013-10-31 16:15:06,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8206799160724257515_1275 src: /127.0.0.1:35704 dest: /127.0.0.1:38271
2013-10-31 16:15:06,789 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35704, dest: /127.0.0.1:38271, bytes: 28628, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8206799160724257515_1275, duration: 91871
2013-10-31 16:15:06,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8206799160724257515_1275 terminating
2013-10-31 16:15:06,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35634, dest: /127.0.0.1:50942, bytes: 28628, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8206799160724257515_1275, duration: 1470412
2013-10-31 16:15:06,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8206799160724257515_1275 terminating
2013-10-31 16:15:06,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48735, dest: /127.0.0.1:47311, bytes: 28628, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8206799160724257515_1275, duration: 1330371
2013-10-31 16:15:06,791 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8206799160724257515_1275 size 28628
2013-10-31 16:15:06,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8206799160724257515_1275 terminating
2013-10-31 16:15:06,793 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml from client DFSClient_708454635
2013-10-31 16:15:06,793 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_conf.xml is closed by DFSClient_708454635
2013-10-31 16:15:06,794 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8206799160724257515_1275 size 28628
2013-10-31 16:15:06,794 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8206799160724257515_1275 size 28628
2013-10-31 16:15:06,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:06,805 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken. blk_1994160069267862725_1276
2013-10-31 16:15:06,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1994160069267862725_1276 src: /127.0.0.1:35705 dest: /127.0.0.1:38271
2013-10-31 16:15:06,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1994160069267862725_1276 src: /127.0.0.1:35637 dest: /127.0.0.1:50942
2013-10-31 16:15:06,808 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1994160069267862725_1276 src: /127.0.0.1:55743 dest: /127.0.0.1:41648
2013-10-31 16:15:06,810 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55743, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1994160069267862725_1276, duration: 606967
2013-10-31 16:15:06,810 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1994160069267862725_1276 terminating
2013-10-31 16:15:06,810 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35637, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1994160069267862725_1276, duration: 334137
2013-10-31 16:15:06,810 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1994160069267862725_1276 terminating
2013-10-31 16:15:06,810 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1994160069267862725_1276 size 116
2013-10-31 16:15:06,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35705, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1994160069267862725_1276, duration: 702296
2013-10-31 16:15:06,811 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1994160069267862725_1276 terminating
2013-10-31 16:15:06,814 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1994160069267862725_1276 size 116
2013-10-31 16:15:06,814 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken from client DFSClient_1457307213
2013-10-31 16:15:06,815 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken is closed by DFSClient_1457307213
2013-10-31 16:15:06,815 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1994160069267862725_1276 size 116
2013-10-31 16:15:06,819 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken
2013-10-31 16:15:06,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.splitmetainfo dst=null perm=null
2013-10-31 16:15:06,822 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55744, bytes: 187, op: HDFS_READ, cliID: DFSClient_708454635, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9086653742670772437_1272, duration: 121179
2013-10-31 16:15:06,823 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0024 = 19. Number of splits = 5
2013-10-31 16:15:06,824 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,824 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,824 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,824 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,825 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,826 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,827 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,827 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0024_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:06,827 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0024 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:15:06,828 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0024 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:15:08,428 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:08,428 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000005_0 not found in cache
2013-10-31 16:15:08,429 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000004_0 not found in cache
2013-10-31 16:15:08,429 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0023 for user-log deletion with retainTimeStamp:1383322508429
2013-10-31 16:15:08,831 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6147278667197761988_1255 file build/test/data/dfs/data/data1/current/blk_-6147278667197761988 for deletion
2013-10-31 16:15:08,831 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_494178843268810844_1249 file build/test/data/dfs/data/data2/current/blk_494178843268810844 for deletion
2013-10-31 16:15:08,831 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6147278667197761988_1255 at file build/test/data/dfs/data/data1/current/blk_-6147278667197761988
2013-10-31 16:15:08,831 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_973369226213168052_1263 file build/test/data/dfs/data/data1/current/blk_973369226213168052 for deletion
2013-10-31 16:15:08,832 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_494178843268810844_1249 at file build/test/data/dfs/data/data2/current/blk_494178843268810844
2013-10-31 16:15:08,832 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_973369226213168052_1263 at file build/test/data/dfs/data/data1/current/blk_973369226213168052
2013-10-31 16:15:08,832 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3293186924092887077_1256 file build/test/data/dfs/data/data2/current/blk_3293186924092887077 for deletion
2013-10-31 16:15:08,833 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4171475749075851274_1253 file build/test/data/dfs/data/data1/current/blk_4171475749075851274 for deletion
2013-10-31 16:15:08,833 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3293186924092887077_1256 at file build/test/data/dfs/data/data2/current/blk_3293186924092887077
2013-10-31 16:15:08,833 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4171475749075851274_1253 at file build/test/data/dfs/data/data1/current/blk_4171475749075851274
2013-10-31 16:15:08,833 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5893390770057608854_1255 file build/test/data/dfs/data/data2/current/blk_5893390770057608854 for deletion
2013-10-31 16:15:08,834 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6836394959299064328_1252 file build/test/data/dfs/data/data2/current/blk_6836394959299064328 for deletion
2013-10-31 16:15:08,834 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5893390770057608854_1255 at file build/test/data/dfs/data/data2/current/blk_5893390770057608854
2013-10-31 16:15:08,834 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7071146985674685312_1251 file build/test/data/dfs/data/data1/current/blk_7071146985674685312 for deletion
2013-10-31 16:15:08,835 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6836394959299064328_1252 at file build/test/data/dfs/data/data2/current/blk_6836394959299064328
2013-10-31 16:15:08,835 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7071146985674685312_1251 at file build/test/data/dfs/data/data1/current/blk_7071146985674685312
2013-10-31 16:15:08,951 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0024_m_000006_0' to tip task_20131031160444934_0024_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:08,954 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:15:08,954 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000006_0 which needs 1 slots
2013-10-31 16:15:08,954 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000006_0 which needs 1 slots
2013-10-31 16:15:08,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken dst=null perm=null
2013-10-31 16:15:08,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35709, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1994160069267862725_1276, duration: 137745
2013-10-31 16:15:08,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml dst=null perm=null
2013-10-31 16:15:08,962 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48744, bytes: 28787, op: HDFS_READ, cliID: DFSClient_1449557602, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1379367158697454854_1273, duration: 153367
2013-10-31 16:15:08,975 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:08,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar dst=null perm=null
2013-10-31 16:15:08,988 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35643, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1449557602, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8544072883402237301_1270, duration: 623052
2013-10-31 16:15:09,033 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_8544072883402237301_1270 to 127.0.0.1:41648
2013-10-31 16:15:09,033 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6147278667197761988_1255 file build/test/data/dfs/data/data8/current/blk_-6147278667197761988 for deletion
2013-10-31 16:15:09,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_973369226213168052_1263 file build/test/data/dfs/data/data8/current/blk_973369226213168052 for deletion
2013-10-31 16:15:09,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6147278667197761988_1255 at file build/test/data/dfs/data/data8/current/blk_-6147278667197761988
2013-10-31 16:15:09,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4171475749075851274_1253 file build/test/data/dfs/data/data8/current/blk_4171475749075851274 for deletion
2013-10-31 16:15:09,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_973369226213168052_1263 at file build/test/data/dfs/data/data8/current/blk_973369226213168052
2013-10-31 16:15:09,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5893390770057608854_1255 file build/test/data/dfs/data/data7/current/blk_5893390770057608854 for deletion
2013-10-31 16:15:09,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4171475749075851274_1253 at file build/test/data/dfs/data/data8/current/blk_4171475749075851274
2013-10-31 16:15:09,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8544072883402237301_1270 src: /127.0.0.1:55750 dest: /127.0.0.1:41648
2013-10-31 16:15:09,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5893390770057608854_1255 at file build/test/data/dfs/data/data7/current/blk_5893390770057608854
2013-10-31 16:15:09,034 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_8544072883402237301_1270 to /127.0.0.1:41648
2013-10-31 16:15:09,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_8544072883402237301_1270 src: /127.0.0.1:55750 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:15:09,037 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8544072883402237301_1270 size 238055
2013-10-31 16:15:09,038 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0023_m_-450470830
2013-10-31 16:15:09,042 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23626 with signal TERM. Exit code 0
2013-10-31 16:15:09,043 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-14244859
2013-10-31 16:15:09,043 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-14244859 spawned.
2013-10-31 16:15:09,044 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000006_0/taskjvm.sh
2013-10-31 16:15:09,103 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:09,104 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:09,104 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:09,104 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_-450470830 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:09,287 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_494178843268810844_1249 blk_6836394959299064328_1252 blk_-6147278667197761988_1255 blk_7071146985674685312_1251 blk_3293186924092887077_1256
2013-10-31 16:15:09,287 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_494178843268810844_1249 blk_973369226213168052_1263 blk_5893390770057608854_1255 blk_6836394959299064328_1252 blk_4171475749075851274_1253 blk_7071146985674685312_1251 blk_3293186924092887077_1256
2013-10-31 16:15:09,358 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_-388264292 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:09,368 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23805 with signal TERM. Exit code 0
2013-10-31 16:15:09,431 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_494178843268810844_1249 file build/test/data/dfs/data/data3/current/blk_494178843268810844 for deletion
2013-10-31 16:15:09,431 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_973369226213168052_1263 file build/test/data/dfs/data/data3/current/blk_973369226213168052 for deletion
2013-10-31 16:15:09,431 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_494178843268810844_1249 at file build/test/data/dfs/data/data3/current/blk_494178843268810844
2013-10-31 16:15:09,431 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3293186924092887077_1256 file build/test/data/dfs/data/data3/current/blk_3293186924092887077 for deletion
2013-10-31 16:15:09,432 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_973369226213168052_1263 at file build/test/data/dfs/data/data3/current/blk_973369226213168052
2013-10-31 16:15:09,432 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4171475749075851274_1253 file build/test/data/dfs/data/data3/current/blk_4171475749075851274 for deletion
2013-10-31 16:15:09,432 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3293186924092887077_1256 at file build/test/data/dfs/data/data3/current/blk_3293186924092887077
2013-10-31 16:15:09,432 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5893390770057608854_1255 file build/test/data/dfs/data/data4/current/blk_5893390770057608854 for deletion
2013-10-31 16:15:09,433 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4171475749075851274_1253 at file build/test/data/dfs/data/data3/current/blk_4171475749075851274
2013-10-31 16:15:09,433 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5893390770057608854_1255 at file build/test/data/dfs/data/data4/current/blk_5893390770057608854
2013-10-31 16:15:09,433 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6836394959299064328_1252 file build/test/data/dfs/data/data4/current/blk_6836394959299064328 for deletion
2013-10-31 16:15:09,433 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6836394959299064328_1252 at file build/test/data/dfs/data/data4/current/blk_6836394959299064328
2013-10-31 16:15:09,433 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7071146985674685312_1251 file build/test/data/dfs/data/data3/current/blk_7071146985674685312 for deletion
2013-10-31 16:15:09,434 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7071146985674685312_1251 at file build/test/data/dfs/data/data3/current/blk_7071146985674685312
2013-10-31 16:15:09,540 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:09,540 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:09,540 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:09,540 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_-388264292 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:09,744 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_1581669948 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:09,752 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24005 with signal TERM. Exit code 0
2013-10-31 16:15:09,915 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:09,916 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:09,916 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:09,916 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_1581669948 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:10,043 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6147278667197761988_1255 file build/test/data/dfs/data/data6/current/blk_-6147278667197761988 for deletion
2013-10-31 16:15:10,043 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_494178843268810844_1249 file build/test/data/dfs/data/data6/current/blk_494178843268810844 for deletion
2013-10-31 16:15:10,043 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6147278667197761988_1255 at file build/test/data/dfs/data/data6/current/blk_-6147278667197761988
2013-10-31 16:15:10,043 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3293186924092887077_1256 file build/test/data/dfs/data/data5/current/blk_3293186924092887077 for deletion
2013-10-31 16:15:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_494178843268810844_1249 at file build/test/data/dfs/data/data6/current/blk_494178843268810844
2013-10-31 16:15:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6836394959299064328_1252 file build/test/data/dfs/data/data5/current/blk_6836394959299064328 for deletion
2013-10-31 16:15:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3293186924092887077_1256 at file build/test/data/dfs/data/data5/current/blk_3293186924092887077
2013-10-31 16:15:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7071146985674685312_1251 file build/test/data/dfs/data/data6/current/blk_7071146985674685312 for deletion
2013-10-31 16:15:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6836394959299064328_1252 at file build/test/data/dfs/data/data5/current/blk_6836394959299064328
2013-10-31 16:15:10,044 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7071146985674685312_1251 at file build/test/data/dfs/data/data6/current/blk_7071146985674685312
2013-10-31 16:15:10,325 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-14244859 given task: attempt_20131031160444934_0024_m_000006_0
2013-10-31 16:15:10,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:10,949 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:10,950 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000000_0 not found in cache
2013-10-31 16:15:10,950 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000001_0 not found in cache
2013-10-31 16:15:10,950 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0023 for user-log deletion with retainTimeStamp:1383322510950
2013-10-31 16:15:11,162 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0023
2013-10-31 16:15:11,163 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000003_0 not found in cache
2013-10-31 16:15:11,163 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0023_m_000002_0 not found in cache
2013-10-31 16:15:11,164 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0023 for user-log deletion with retainTimeStamp:1383322511164
2013-10-31 16:15:11,602 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_1264514395 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:11,613 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23737 with signal TERM. Exit code 0
2013-10-31 16:15:11,819 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:11,820 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:11,820 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:11,820 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_1264514395 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:12,271 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_188051683 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:12,281 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23488 with signal TERM. Exit code 0
2013-10-31 16:15:12,360 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0023_m_-1577082009 since job job_20131031160444934_0023 is dead
2013-10-31 16:15:12,365 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23778 with signal TERM. Exit code 0
2013-10-31 16:15:12,446 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:12,446 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:12,446 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:12,447 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_188051683 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:15:12,517 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:12,517 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:12,518 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:12,518 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0023_m_-1577082009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:13,781 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000006_0 0.0% setup
2013-10-31 16:15:13,784 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000006_0 is done.
2013-10-31 16:15:13,784 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000006_0 was -1
2013-10-31 16:15:13,784 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:14,960 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000006_0' has completed task_20131031160444934_0024_m_000006 successfully.
2013-10-31 16:15:14,963 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000000_0' to tip task_20131031160444934_0024_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:14,964 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000000
2013-10-31 16:15:14,965 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000001_0' to tip task_20131031160444934_0024_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:14,965 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000001
2013-10-31 16:15:14,967 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:15:14,969 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:15:14,969 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000000_0 which needs 1 slots
2013-10-31 16:15:14,969 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000000_0 which needs 1 slots
2013-10-31 16:15:14,970 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000001_0 which needs 1 slots
2013-10-31 16:15:14,970 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0024_m_000001_0 which needs 1 slots
2013-10-31 16:15:15,005 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_624470708
2013-10-31 16:15:15,006 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_624470708 spawned.
2013-10-31 16:15:15,009 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000001_0/taskjvm.sh
2013-10-31 16:15:15,012 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0024/attempt_20131031160444934_0024_m_000000_0. Attempting to reuse: jvm_20131031160444934_0024_m_-14244859
2013-10-31 16:15:15,172 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000002_0' to tip task_20131031160444934_0024_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:15,172 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000002
2013-10-31 16:15:15,172 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000003_0' to tip task_20131031160444934_0024_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:15,172 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000003
2013-10-31 16:15:15,173 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:15:15,174 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:15:15,174 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000002_0 which needs 1 slots
2013-10-31 16:15:15,174 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000002_0 which needs 1 slots
2013-10-31 16:15:15,174 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000003_0 which needs 1 slots
2013-10-31 16:15:15,174 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0024_m_000003_0 which needs 1 slots
2013-10-31 16:15:15,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken dst=null perm=null
2013-10-31 16:15:15,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35718, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1994160069267862725_1276, duration: 138607
2013-10-31 16:15:15,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml dst=null perm=null
2013-10-31 16:15:15,182 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48753, bytes: 28787, op: HDFS_READ, cliID: DFSClient_-1782677983, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1379367158697454854_1273, duration: 202207
2013-10-31 16:15:15,196 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:15,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar dst=null perm=null
2013-10-31 16:15:15,215 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35652, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1782677983, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8544072883402237301_1270, duration: 685233
2013-10-31 16:15:15,274 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-2014524527
2013-10-31 16:15:15,275 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-2014524527 spawned.
2013-10-31 16:15:15,275 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-318845689
2013-10-31 16:15:15,275 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-318845689 spawned.
2013-10-31 16:15:15,276 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000002_0/taskjvm.sh
2013-10-31 16:15:15,276 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000003_0/taskjvm.sh
2013-10-31 16:15:15,351 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-14244859 given task: attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:15,388 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0024_m_000004_0' to tip task_20131031160444934_0024_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:15:15,388 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0024_m_000004
2013-10-31 16:15:15,389 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:15:15,389 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000004_0 which needs 1 slots
2013-10-31 16:15:15,389 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000004_0 which needs 1 slots
2013-10-31 16:15:15,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024/jobToken dst=null perm=null
2013-10-31 16:15:15,393 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35653, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1994160069267862725_1276, duration: 150482
2013-10-31 16:15:15,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.xml dst=null perm=null
2013-10-31 16:15:15,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35724, bytes: 28787, op: HDFS_READ, cliID: DFSClient_14295467, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1379367158697454854_1273, duration: 161917
2013-10-31 16:15:15,412 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:15,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.jar dst=null perm=null
2013-10-31 16:15:15,427 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35726, bytes: 239915, op: HDFS_READ, cliID: DFSClient_14295467, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8544072883402237301_1270, duration: 751040
2013-10-31 16:15:15,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=null
2013-10-31 16:15:15,457 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35658, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2440796546292724629_1271, duration: 160720
2013-10-31 16:15:15,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:15:15,540 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_-2077162363
2013-10-31 16:15:15,541 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_-2077162363 spawned.
2013-10-31 16:15:15,542 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000004_0/taskjvm.sh
2013-10-31 16:15:15,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:15,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:15,820 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_624470708 given task: attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:15,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:15,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:15,959 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35661, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 129767
2013-10-31 16:15:15,963 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48764, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 191105
2013-10-31 16:15:15,969 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000. blk_2623433961007257862_1277
2013-10-31 16:15:15,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2623433961007257862_1277 src: /127.0.0.1:55768 dest: /127.0.0.1:41648
2013-10-31 16:15:15,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2623433961007257862_1277 src: /127.0.0.1:35664 dest: /127.0.0.1:50942
2013-10-31 16:15:15,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2623433961007257862_1277 src: /127.0.0.1:35734 dest: /127.0.0.1:38271
2013-10-31 16:15:15,997 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35734, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 1924981
2013-10-31 16:15:15,997 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2623433961007257862_1277 terminating
2013-10-31 16:15:15,998 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35664, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2623433961007257862_1277, duration: 2345145
2013-10-31 16:15:15,998 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2623433961007257862_1277 terminating
2013-10-31 16:15:15,998 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55768, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2623433961007257862_1277, duration: 2928886
2013-10-31 16:15:15,999 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2623433961007257862_1277 terminating
2013-10-31 16:15:15,999 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2623433961007257862_1277 size 104
2013-10-31 16:15:15,999 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2623433961007257862_1277 size 104
2013-10-31 16:15:16,000 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2623433961007257862_1277 size 104
2013-10-31 16:15:16,000 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:16,000 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:16,039 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:16,039 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000000_0 0.0%
2013-10-31 16:15:16,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=null
2013-10-31 16:15:16,330 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-2014524527 given task: attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:16,331 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55773, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2440796546292724629_1271, duration: 162069
2013-10-31 16:15:16,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:15:16,370 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35740, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 122314
2013-10-31 16:15:16,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:16,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:16,526 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-318845689 given task: attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:16,530 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_-2077162363 given task: attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:16,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:16,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:16,625 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48774, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 122867
2013-10-31 16:15:16,635 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001. blk_2558601193971908172_1278
2013-10-31 16:15:16,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2558601193971908172_1278 src: /127.0.0.1:55778 dest: /127.0.0.1:41648
2013-10-31 16:15:16,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2558601193971908172_1278 src: /127.0.0.1:48776 dest: /127.0.0.1:47311
2013-10-31 16:15:16,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2558601193971908172_1278 src: /127.0.0.1:35744 dest: /127.0.0.1:38271
2013-10-31 16:15:16,661 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35744, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2558601193971908172_1278, duration: 1131354
2013-10-31 16:15:16,662 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2558601193971908172_1278 terminating
2013-10-31 16:15:16,662 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48776, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2558601193971908172_1278, duration: 1488949
2013-10-31 16:15:16,662 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2558601193971908172_1278 terminating
2013-10-31 16:15:16,662 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55778, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 1860337
2013-10-31 16:15:16,662 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2558601193971908172_1278 terminating
2013-10-31 16:15:16,664 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2558601193971908172_1278 size 104
2013-10-31 16:15:16,665 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2558601193971908172_1278 size 104
2013-10-31 16:15:16,666 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2558601193971908172_1278 size 104
2013-10-31 16:15:16,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=null
2013-10-31 16:15:16,855 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35746, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2440796546292724629_1271, duration: 216871
2013-10-31 16:15:16,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:15:16,896 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35678, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 266045
2013-10-31 16:15:16,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:16,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:17,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=null
2013-10-31 16:15:17,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024/job.split dst=null perm=null
2013-10-31 16:15:17,032 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48783, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2440796546292724629_1271, duration: 164383
2013-10-31 16:15:17,033 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35682, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2440796546292724629_1271, duration: 138524
2013-10-31 16:15:17,064 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:17,065 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:17,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:15:17,072 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35683, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 266314
2013-10-31 16:15:17,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:15:17,084 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48786, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 104048
2013-10-31 16:15:17,113 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,113 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000001_0 0.0%
2013-10-31 16:15:17,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:17,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:17,316 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35685, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 289617
2013-10-31 16:15:17,326 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002. blk_-7985283914289950420_1279
2013-10-31 16:15:17,348 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7985283914289950420_1279 src: /127.0.0.1:35755 dest: /127.0.0.1:38271
2013-10-31 16:15:17,356 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7985283914289950420_1279 src: /127.0.0.1:55792 dest: /127.0.0.1:41648
2013-10-31 16:15:17,357 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7985283914289950420_1279 src: /127.0.0.1:35688 dest: /127.0.0.1:50942
2013-10-31 16:15:17,363 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35688, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7985283914289950420_1279, duration: 1504444
2013-10-31 16:15:17,363 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7985283914289950420_1279 terminating
2013-10-31 16:15:17,364 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55792, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7985283914289950420_1279, duration: 4284465
2013-10-31 16:15:17,365 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7985283914289950420_1279 terminating
2013-10-31 16:15:17,365 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35755, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7985283914289950420_1279, duration: 5808381
2013-10-31 16:15:17,365 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7985283914289950420_1279 terminating
2013-10-31 16:15:17,372 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7985283914289950420_1279 size 104
2013-10-31 16:15:17,372 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7985283914289950420_1279 size 104
2013-10-31 16:15:17,372 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7985283914289950420_1279 size 104
2013-10-31 16:15:17,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:17,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:17,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:17,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:17,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:17,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:17,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:17,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48791, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 135657
2013-10-31 16:15:17,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:17,733 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48792, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 96210
2013-10-31 16:15:17,739 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003. blk_1719649238952092533_1281
2013-10-31 16:15:17,743 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004. blk_-8601652280056973022_1281
2013-10-31 16:15:17,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1719649238952092533_1281 src: /127.0.0.1:55796 dest: /127.0.0.1:41648
2013-10-31 16:15:17,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1719649238952092533_1281 src: /127.0.0.1:35762 dest: /127.0.0.1:38271
2013-10-31 16:15:17,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1719649238952092533_1281 src: /127.0.0.1:35694 dest: /127.0.0.1:50942
2013-10-31 16:15:17,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8601652280056973022_1281 src: /127.0.0.1:55797 dest: /127.0.0.1:41648
2013-10-31 16:15:17,767 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8601652280056973022_1281 src: /127.0.0.1:35764 dest: /127.0.0.1:38271
2013-10-31 16:15:17,767 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35694, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1719649238952092533_1281, duration: 1714064
2013-10-31 16:15:17,767 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1719649238952092533_1281 terminating
2013-10-31 16:15:17,767 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1719649238952092533_1281 size 104
2013-10-31 16:15:17,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35762, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 1859649
2013-10-31 16:15:17,768 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8601652280056973022_1281 src: /127.0.0.1:35696 dest: /127.0.0.1:50942
2013-10-31 16:15:17,768 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1719649238952092533_1281 terminating
2013-10-31 16:15:17,769 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55796, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1719649238952092533_1281, duration: 2747832
2013-10-31 16:15:17,769 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1719649238952092533_1281 terminating
2013-10-31 16:15:17,770 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1719649238952092533_1281 size 104
2013-10-31 16:15:17,771 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:17,771 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:17,771 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35696, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8601652280056973022_1281, duration: 1572621
2013-10-31 16:15:17,771 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8601652280056973022_1281 terminating
2013-10-31 16:15:17,772 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35764, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 1297963
2013-10-31 16:15:17,772 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8601652280056973022_1281 terminating
2013-10-31 16:15:17,772 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:17,773 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:17,773 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55797, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0024_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8601652280056973022_1281, duration: 2331223
2013-10-31 16:15:17,773 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1719649238952092533_1281 size 104
2013-10-31 16:15:17,773 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8601652280056973022_1281 terminating
2013-10-31 16:15:17,774 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8601652280056973022_1281 size 104
2013-10-31 16:15:17,775 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8601652280056973022_1281 size 104
2013-10-31 16:15:17,775 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:17,775 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:17,776 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8601652280056973022_1281 size 104
2013-10-31 16:15:17,834 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,834 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,834 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000004_0 0.0%
2013-10-31 16:15:17,834 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000003_0 0.0%
2013-10-31 16:15:17,835 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0024_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:17,835 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000002_0 0.0%
2013-10-31 16:15:17,973 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000000_0
2013-10-31 16:15:17,973 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000001_0
2013-10-31 16:15:18,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0 dst=null perm=null
2013-10-31 16:15:18,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000000_0 dst=null perm=null
2013-10-31 16:15:18,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0 dst=null perm=null
2013-10-31 16:15:18,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000001_0 dst=null perm=null
2013-10-31 16:15:18,178 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000002_0
2013-10-31 16:15:18,178 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000003_0
2013-10-31 16:15:18,392 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0024_m_000004_0
2013-10-31 16:15:18,418 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:15:18,420 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000000_0 is done.
2013-10-31 16:15:18,420 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000000_0 was -1
2013-10-31 16:15:18,420 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:18,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0 dst=null perm=null
2013-10-31 16:15:18,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0 dst=null perm=null
2013-10-31 16:15:18,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0 dst=null perm=null
2013-10-31 16:15:18,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:18,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0/part-00004 dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:18,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000003_0 dst=null perm=null
2013-10-31 16:15:18,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000002_0 dst=null perm=null
2013-10-31 16:15:18,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary/_attempt_20131031160444934_0024_m_000004_0 dst=null perm=null
2013-10-31 16:15:19,259 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:15:19,261 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000001_0 is done.
2013-10-31 16:15:19,261 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000001_0 was -1
2013-10-31 16:15:19,261 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:19,781 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:15:19,783 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000002_0 is done.
2013-10-31 16:15:19,783 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000002_0 was -1
2013-10-31 16:15:19,784 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:19,957 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:15:19,959 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:15:19,959 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000003_0 is done.
2013-10-31 16:15:19,959 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000003_0 was -1
2013-10-31 16:15:19,960 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:19,960 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000004_0 is done.
2013-10-31 16:15:19,960 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000004_0 was -1
2013-10-31 16:15:19,960 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:19,969 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0024_m_000006_0
2013-10-31 16:15:19,969 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0024_m_000006_0
2013-10-31 16:15:19,970 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000006_0 not found in cache
2013-10-31 16:15:20,978 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000000_0' has completed task_20131031160444934_0024_m_000000 successfully.
2013-10-31 16:15:20,979 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000001_0' has completed task_20131031160444934_0024_m_000001 successfully.
2013-10-31 16:15:21,182 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000002_0' has completed task_20131031160444934_0024_m_000002 successfully.
2013-10-31 16:15:21,183 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000003_0' has completed task_20131031160444934_0024_m_000003 successfully.
2013-10-31 16:15:21,395 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000004_0' has completed task_20131031160444934_0024_m_000004 successfully.
2013-10-31 16:15:21,398 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0024_m_000005_0' to tip task_20131031160444934_0024_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:15:21,402 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0024_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:15:21,402 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0024_m_000005_0 which needs 1 slots
2013-10-31 16:15:21,402 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0024_m_000005_0 which needs 1 slots
2013-10-31 16:15:21,440 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0024_m_543313488
2013-10-31 16:15:21,441 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0024_m_543313488 spawned.
2013-10-31 16:15:21,444 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0024/attempt_20131031160444934_0024_m_000005_0/taskjvm.sh
2013-10-31 16:15:22,346 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0024_m_543313488 given task: attempt_20131031160444934_0024_m_000005_0
2013-10-31 16:15:22,858 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000005_0 0.0%
2013-10-31 16:15:22,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_temporary dst=null perm=null
2013-10-31 16:15:22,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:22,880 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_SUCCESS from client DFSClient_attempt_20131031160444934_0024_m_000005_0
2013-10-31 16:15:22,880 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0024_m_000005_0
2013-10-31 16:15:22,887 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:22,887 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,887 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:22,887 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8544072883402237301 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,887 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:22,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2440796546292724629 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:22,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9086653742670772437 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9086653742670772437 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:22,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9086653742670772437 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,889 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1379367158697454854 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:22,889 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1379367158697454854 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:22,889 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1379367158697454854 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:23,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0024 dst=null perm=null
2013-10-31 16:15:24,290 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-9086653742670772437_1272 blk_2440796546292724629_1271 blk_-1379367158697454854_1273 blk_8544072883402237301_1270
2013-10-31 16:15:24,290 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-9086653742670772437_1272 blk_2440796546292724629_1271 blk_-1379367158697454854_1273 blk_8544072883402237301_1270
2013-10-31 16:15:25,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9086653742670772437_1272 file build/test/data/dfs/data/data5/current/blk_-9086653742670772437 for deletion
2013-10-31 16:15:25,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1379367158697454854_1273 file build/test/data/dfs/data/data6/current/blk_-1379367158697454854 for deletion
2013-10-31 16:15:25,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9086653742670772437_1272 at file build/test/data/dfs/data/data5/current/blk_-9086653742670772437
2013-10-31 16:15:25,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data6/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:25,050 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1379367158697454854_1273 at file build/test/data/dfs/data/data6/current/blk_-1379367158697454854
2013-10-31 16:15:25,050 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data6/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:25,050 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data6/current/blk_2440796546292724629
2013-10-31 16:15:25,051 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data6/current/blk_8544072883402237301
2013-10-31 16:15:25,788 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0024_m_000005_0 0.0% cleanup
2013-10-31 16:15:25,790 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0024_m_000005_0 is done.
2013-10-31 16:15:25,790 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0024_m_000005_0 was -1
2013-10-31 16:15:25,790 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9086653742670772437_1272 file build/test/data/dfs/data/data2/current/blk_-9086653742670772437 for deletion
2013-10-31 16:15:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1379367158697454854_1273 file build/test/data/dfs/data/data1/current/blk_-1379367158697454854 for deletion
2013-10-31 16:15:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9086653742670772437_1272 at file build/test/data/dfs/data/data2/current/blk_-9086653742670772437
2013-10-31 16:15:26,838 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1379367158697454854_1273 at file build/test/data/dfs/data/data1/current/blk_-1379367158697454854
2013-10-31 16:15:26,838 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data1/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:26,838 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data2/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:26,838 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data1/current/blk_2440796546292724629
2013-10-31 16:15:26,839 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data2/current/blk_8544072883402237301
2013-10-31 16:15:27,291 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-9086653742670772437_1272 blk_2440796546292724629_1271 blk_-1379367158697454854_1273 blk_8544072883402237301_1270
2013-10-31 16:15:27,291 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_2440796546292724629_1271 blk_8544072883402237301_1270
2013-10-31 16:15:27,408 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0024_m_000005_0' has completed task_20131031160444934_0024_m_000005 successfully.
2013-10-31 16:15:27,409 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0024 has completed successfully.
2013-10-31 16:15:27,409 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0024,submitTime=1383236106752,launchTime=1383236106827,firstMapTaskLaunchTime=1383236114963,firstJobSetupTaskLaunchTime=1383236108951,firstJobCleanupTaskLaunchTime=1383236121397,finishTime=1383236127409,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[ED56FF6D03804A6891662367F6814562/5886B95B0336446D9321F550152F5088] upper2*lower*upper1/(2/2)
2013-10-31 16:15:27,417 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D. blk_-750470584501963121_1282
2013-10-31 16:15:27,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-750470584501963121_1282 src: /127.0.0.1:35769 dest: /127.0.0.1:38271
2013-10-31 16:15:27,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-750470584501963121_1282 src: /127.0.0.1:48803 dest: /127.0.0.1:47311
2013-10-31 16:15:27,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-750470584501963121_1282 src: /127.0.0.1:55807 dest: /127.0.0.1:41648
2013-10-31 16:15:27,426 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55807, dest: /127.0.0.1:41648, bytes: 26355, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-750470584501963121_1282, duration: 1380919
2013-10-31 16:15:27,426 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-750470584501963121_1282 terminating
2013-10-31 16:15:27,426 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-750470584501963121_1282 size 26355
2013-10-31 16:15:27,427 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48803, dest: /127.0.0.1:47311, bytes: 26355, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-750470584501963121_1282, duration: 1246329
2013-10-31 16:15:27,428 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-750470584501963121_1282 terminating
2013-10-31 16:15:27,428 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35769, dest: /127.0.0.1:38271, bytes: 26355, op: HDFS_WRITE, cliID: DFSClient_708454635, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-750470584501963121_1282, duration: 2561948
2013-10-31 16:15:27,429 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-750470584501963121_1282 terminating
2013-10-31 16:15:27,433 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-750470584501963121_1282 size 26355
2013-10-31 16:15:27,434 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D from client DFSClient_708454635
2013-10-31 16:15:27,434 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/_logs/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D is closed by DFSClient_708454635
2013-10-31 16:15:27,435 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-750470584501963121_1282 size 26355
2013-10-31 16:15:27,437 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9086653742670772437_1272 file build/test/data/dfs/data/data4/current/blk_-9086653742670772437 for deletion
2013-10-31 16:15:27,437 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1379367158697454854_1273 file build/test/data/dfs/data/data3/current/blk_-1379367158697454854 for deletion
2013-10-31 16:15:27,437 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9086653742670772437_1272 at file build/test/data/dfs/data/data4/current/blk_-9086653742670772437
2013-10-31 16:15:27,437 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data3/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:27,437 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1379367158697454854_1273 at file build/test/data/dfs/data/data3/current/blk_-1379367158697454854
2013-10-31 16:15:27,438 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data4/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:27,438 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data3/current/blk_2440796546292724629
2013-10-31 16:15:27,438 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data4/current/blk_8544072883402237301
2013-10-31 16:15:27,443 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0024_1383236106752_hadoop_%5BED56FF6D03804A6891662367F6814562%2F5886B95B0336446D to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:27,444 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000004_0'
2013-10-31 16:15:27,444 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000005_0'
2013-10-31 16:15:27,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1994160069267862725 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:27,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1994160069267862725 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:27,446 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1994160069267862725 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:27,448 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] starting step: (1/2) ...orm/joinaroundjoinswapped
2013-10-31 16:15:27,449 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0024_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:27,449 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:27,450 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0024 being deleted.
2013-10-31 16:15:27,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0024 dst=null perm=null
2013-10-31 16:15:27,454 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:15:27,455 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:15:27,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:27,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:15:27,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,478 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar. blk_-3002501081053343053_1283
2013-10-31 16:15:27,479 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:55809 dest: /127.0.0.1:41648
2013-10-31 16:15:27,481 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:48807 dest: /127.0.0.1:47311
2013-10-31 16:15:27,482 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:35775 dest: /127.0.0.1:38271
2013-10-31 16:15:27,490 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35775, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3002501081053343053_1283, duration: 3754857
2013-10-31 16:15:27,490 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3002501081053343053_1283 terminating
2013-10-31 16:15:27,490 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48807, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3002501081053343053_1283, duration: 4516186
2013-10-31 16:15:27,491 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:27,491 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3002501081053343053_1283 terminating
2013-10-31 16:15:27,491 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55809, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3002501081053343053_1283, duration: 5589826
2013-10-31 16:15:27,492 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3002501081053343053_1283 terminating
2013-10-31 16:15:27,493 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:27,494 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar from client DFSClient_1457307213
2013-10-31 16:15:27,494 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar is closed by DFSClient_1457307213
2013-10-31 16:15:27,495 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:27,500 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar. New replication is 10
2013-10-31 16:15:27,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar dst=null perm=null
2013-10-31 16:15:27,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,512 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:15:27,516 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:15:27,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:27,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,533 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split. New replication is 10
2013-10-31 16:15:27,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=null
2013-10-31 16:15:27,540 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split. blk_-7897376192076226208_1284
2013-10-31 16:15:27,541 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:55812 dest: /127.0.0.1:41648
2013-10-31 16:15:27,543 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:48810 dest: /127.0.0.1:47311
2013-10-31 16:15:27,545 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:35778 dest: /127.0.0.1:38271
2013-10-31 16:15:27,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7897376192076226208_1284 src: /127.0.0.1:35710 dest: /127.0.0.1:50942
2013-10-31 16:15:27,549 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35710, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 112541
2013-10-31 16:15:27,550 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,550 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,550 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35778, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7897376192076226208_1284, duration: 946481
2013-10-31 16:15:27,551 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,551 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48810, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7897376192076226208_1284, duration: 2009292
2013-10-31 16:15:27,552 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,552 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55812, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7897376192076226208_1284, duration: 2867257
2013-10-31 16:15:27,553 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7897376192076226208_1284 terminating
2013-10-31 16:15:27,554 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,554 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split from client DFSClient_1457307213
2013-10-31 16:15:27,555 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split is closed by DFSClient_1457307213
2013-10-31 16:15:27,555 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,557 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7897376192076226208_1284 size 1732
2013-10-31 16:15:27,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,576 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo. blk_-3800742364459467549_1285
2013-10-31 16:15:27,577 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3800742364459467549_1285 src: /127.0.0.1:48813 dest: /127.0.0.1:47311
2013-10-31 16:15:27,579 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3800742364459467549_1285 src: /127.0.0.1:35781 dest: /127.0.0.1:38271
2013-10-31 16:15:27,581 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3800742364459467549_1285 src: /127.0.0.1:55818 dest: /127.0.0.1:41648
2013-10-31 16:15:27,584 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55818, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3800742364459467549_1285, duration: 62272
2013-10-31 16:15:27,584 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3800742364459467549_1285 terminating
2013-10-31 16:15:27,584 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35781, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3800742364459467549_1285, duration: 833676
2013-10-31 16:15:27,585 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3800742364459467549_1285 terminating
2013-10-31 16:15:27,585 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48813, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3800742364459467549_1285, duration: 1652085
2013-10-31 16:15:27,586 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3800742364459467549_1285 size 183
2013-10-31 16:15:27,586 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3800742364459467549_1285 terminating
2013-10-31 16:15:27,588 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3800742364459467549_1285 size 183
2013-10-31 16:15:27,588 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:15:27,589 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:15:27,589 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3800742364459467549_1285 size 183
2013-10-31 16:15:27,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:27,621 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml. blk_3515738870572374906_1286
2013-10-31 16:15:27,623 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3515738870572374906_1286 src: /127.0.0.1:35714 dest: /127.0.0.1:50942
2013-10-31 16:15:27,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3515738870572374906_1286 src: /127.0.0.1:48817 dest: /127.0.0.1:47311
2013-10-31 16:15:27,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3515738870572374906_1286 src: /127.0.0.1:35785 dest: /127.0.0.1:38271
2013-10-31 16:15:27,629 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35785, dest: /127.0.0.1:38271, bytes: 28718, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3515738870572374906_1286, duration: 85810
2013-10-31 16:15:27,629 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3515738870572374906_1286 terminating
2013-10-31 16:15:27,629 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3515738870572374906_1286 size 28718
2013-10-31 16:15:27,629 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48817, dest: /127.0.0.1:47311, bytes: 28718, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3515738870572374906_1286, duration: 865359
2013-10-31 16:15:27,630 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3515738870572374906_1286 size 28718
2013-10-31 16:15:27,630 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3515738870572374906_1286 terminating
2013-10-31 16:15:27,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35714, dest: /127.0.0.1:50942, bytes: 28718, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3515738870572374906_1286, duration: 1893934
2013-10-31 16:15:27,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3515738870572374906_1286 terminating
2013-10-31 16:15:27,634 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3515738870572374906_1286 size 28718
2013-10-31 16:15:27,634 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml from client DFSClient_1457307213
2013-10-31 16:15:27,635 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml is closed by DFSClient_1457307213
2013-10-31 16:15:27,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml dst=null perm=null
2013-10-31 16:15:27,649 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35718, bytes: 28946, op: HDFS_READ, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3515738870572374906_1286, duration: 377502
2013-10-31 16:15:27,668 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0025: nMaps=5 nReduces=0 max=-1
2013-10-31 16:15:27,669 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0025 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:15:27,669 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0025
2013-10-31 16:15:27,669 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0025 RESULT=SUCCESS
2013-10-31 16:15:27,669 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0025
2013-10-31 16:15:27,671 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [upper2*lower*upper1] submitted hadoop job: job_20131031160444934_0025
2013-10-31 16:15:28,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:28,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:28,337 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml. blk_-2854511013015993238_1288
2013-10-31 16:15:28,339 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2854511013015993238_1288 src: /127.0.0.1:48821 dest: /127.0.0.1:47311
2013-10-31 16:15:28,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2854511013015993238_1288 src: /127.0.0.1:55825 dest: /127.0.0.1:41648
2013-10-31 16:15:28,343 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2854511013015993238_1288 src: /127.0.0.1:35721 dest: /127.0.0.1:50942
2013-10-31 16:15:28,347 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35721, dest: /127.0.0.1:50942, bytes: 28783, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2854511013015993238_1288, duration: 770468
2013-10-31 16:15:28,347 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2854511013015993238_1288 terminating
2013-10-31 16:15:28,348 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55825, dest: /127.0.0.1:41648, bytes: 28783, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2854511013015993238_1288, duration: 1608239
2013-10-31 16:15:28,348 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2854511013015993238_1288 terminating
2013-10-31 16:15:28,348 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48821, dest: /127.0.0.1:47311, bytes: 28783, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2854511013015993238_1288, duration: 2836448
2013-10-31 16:15:28,349 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2854511013015993238_1288 size 28783
2013-10-31 16:15:28,349 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2854511013015993238_1288 terminating
2013-10-31 16:15:28,351 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2854511013015993238_1288 size 28783
2013-10-31 16:15:28,351 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml from client DFSClient_-460164648
2013-10-31 16:15:28,352 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_conf.xml is closed by DFSClient_-460164648
2013-10-31 16:15:28,352 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2854511013015993238_1288 size 28783
2013-10-31 16:15:28,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:28,366 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken. blk_-661464544657018414_1289
2013-10-31 16:15:28,367 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-661464544657018414_1289 src: /127.0.0.1:35722 dest: /127.0.0.1:50942
2013-10-31 16:15:28,369 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-661464544657018414_1289 src: /127.0.0.1:35792 dest: /127.0.0.1:38271
2013-10-31 16:15:28,370 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-661464544657018414_1289 src: /127.0.0.1:48826 dest: /127.0.0.1:47311
2013-10-31 16:15:28,374 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48826, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-661464544657018414_1289, duration: 87571
2013-10-31 16:15:28,374 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-661464544657018414_1289 terminating
2013-10-31 16:15:28,374 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-661464544657018414_1289 size 116
2013-10-31 16:15:28,375 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35792, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-661464544657018414_1289, duration: 918157
2013-10-31 16:15:28,375 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-661464544657018414_1289 terminating
2013-10-31 16:15:28,376 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35722, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-661464544657018414_1289, duration: 2099909
2013-10-31 16:15:28,376 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-661464544657018414_1289 size 116
2013-10-31 16:15:28,376 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-661464544657018414_1289 terminating
2013-10-31 16:15:28,381 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-661464544657018414_1289 size 116
2013-10-31 16:15:28,382 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken from client DFSClient_1457307213
2013-10-31 16:15:28,382 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken is closed by DFSClient_1457307213
2013-10-31 16:15:28,389 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken
2013-10-31 16:15:28,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.splitmetainfo dst=null perm=null
2013-10-31 16:15:28,393 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55830, bytes: 187, op: HDFS_READ, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3800742364459467549_1285, duration: 270477
2013-10-31 16:15:28,394 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0025 = 19. Number of splits = 5
2013-10-31 16:15:28,395 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,395 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,395 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,395 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,396 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,397 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0025_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:28,398 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0025 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:15:28,399 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0025 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:15:29,993 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0025_m_000006_0' to tip task_20131031160444934_0025_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:29,998 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000000_0'
2013-10-31 16:15:29,998 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000001_0'
2013-10-31 16:15:29,998 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000006_0'
2013-10-31 16:15:30,000 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:15:30,000 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000006_0 which needs 1 slots
2013-10-31 16:15:30,000 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000006_0 which needs 1 slots
2013-10-31 16:15:30,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken dst=null perm=null
2013-10-31 16:15:30,009 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35795, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-661464544657018414_1289, duration: 281317
2013-10-31 16:15:30,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml dst=null perm=null
2013-10-31 16:15:30,019 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48830, bytes: 28946, op: HDFS_READ, cliID: DFSClient_-733898883, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3515738870572374906_1286, duration: 399003
2013-10-31 16:15:30,041 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2440796546292724629_1271 file build/test/data/dfs/data/data7/current/blk_2440796546292724629 for deletion
2013-10-31 16:15:30,041 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2440796546292724629_1271 at file build/test/data/dfs/data/data7/current/blk_2440796546292724629
2013-10-31 16:15:30,041 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8544072883402237301_1270 file build/test/data/dfs/data/data8/current/blk_8544072883402237301 for deletion
2013-10-31 16:15:30,041 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8544072883402237301_1270 at file build/test/data/dfs/data/data8/current/blk_8544072883402237301
2013-10-31 16:15:30,050 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:30,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar dst=null perm=null
2013-10-31 16:15:30,070 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48831, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-733898883, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3002501081053343053_1283, duration: 619648
2013-10-31 16:15:30,145 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0024_m_624470708
2013-10-31 16:15:30,152 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24986 with signal TERM. Exit code 0
2013-10-31 16:15:30,153 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_-2015129647
2013-10-31 16:15:30,153 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_-2015129647 spawned.
2013-10-31 16:15:30,160 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000006_0/taskjvm.sh
2013-10-31 16:15:30,193 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000002_0'
2013-10-31 16:15:30,194 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0024_m_000003_0'
2013-10-31 16:15:30,225 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:30,225 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:30,226 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:30,226 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_624470708 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:30,292 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-3002501081053343053_1283 to datanode(s) 127.0.0.1:50942
2013-10-31 16:15:30,292 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_1994160069267862725_1276
2013-10-31 16:15:30,293 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_1994160069267862725_1276
2013-10-31 16:15:31,520 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-2015129647 given task: attempt_20131031160444934_0025_m_000006_0
2013-10-31 16:15:32,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:32,446 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:32,446 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000005_0 not found in cache
2013-10-31 16:15:32,447 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000004_0 not found in cache
2013-10-31 16:15:32,447 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0024 for user-log deletion with retainTimeStamp:1383322532447
2013-10-31 16:15:32,522 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-2077162363 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:32,533 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25104 with signal TERM. Exit code 0
2013-10-31 16:15:32,721 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:32,721 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:32,721 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:32,722 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-2077162363 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:32,839 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-3002501081053343053_1283 to 127.0.0.1:50942
2013-10-31 16:15:32,839 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1994160069267862725_1276 file build/test/data/dfs/data/data1/current/blk_1994160069267862725 for deletion
2013-10-31 16:15:32,840 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1994160069267862725_1276 at file build/test/data/dfs/data/data1/current/blk_1994160069267862725
2013-10-31 16:15:32,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3002501081053343053_1283 src: /127.0.0.1:35733 dest: /127.0.0.1:50942
2013-10-31 16:15:32,841 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-3002501081053343053_1283 to /127.0.0.1:50942
2013-10-31 16:15:32,844 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3002501081053343053_1283 src: /127.0.0.1:35733 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:15:32,846 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3002501081053343053_1283 size 238055
2013-10-31 16:15:32,847 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 16:15:32,851 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 4ms
2013-10-31 16:15:33,040 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 16:15:33,047 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:50942, blocks: 81, processing time: 6 msecs
2013-10-31 16:15:33,048 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 81 blocks took 0 msec to generate and 8 msecs for RPC and NN processing
2013-10-31 16:15:33,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1994160069267862725_1276 file build/test/data/dfs/data/data7/current/blk_1994160069267862725 for deletion
2013-10-31 16:15:33,050 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1994160069267862725_1276 at file build/test/data/dfs/data/data7/current/blk_1994160069267862725
2013-10-31 16:15:33,293 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_1994160069267862725_1276
2013-10-31 16:15:33,861 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_543313488 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:33,872 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25329 with signal TERM. Exit code 0
2013-10-31 16:15:34,045 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:34,045 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:34,045 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:34,046 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_543313488 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:34,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1994160069267862725_1276 file build/test/data/dfs/data/data5/current/blk_1994160069267862725 for deletion
2013-10-31 16:15:34,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1994160069267862725_1276 at file build/test/data/dfs/data/data5/current/blk_1994160069267862725
2013-10-31 16:15:34,959 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000006_0 0.0% setup
2013-10-31 16:15:34,962 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000006_0 is done.
2013-10-31 16:15:34,962 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000006_0 was -1
2013-10-31 16:15:34,962 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:35,000 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:35,000 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000001_0 not found in cache
2013-10-31 16:15:35,000 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000000_0 not found in cache
2013-10-31 16:15:35,001 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0024 for user-log deletion with retainTimeStamp:1383322535001
2013-10-31 16:15:35,194 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0024
2013-10-31 16:15:35,195 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000002_0 not found in cache
2013-10-31 16:15:35,195 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0024_m_000003_0 not found in cache
2013-10-31 16:15:35,195 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0024 for user-log deletion with retainTimeStamp:1383322535195
2013-10-31 16:15:35,350 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-2014524527 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:35,359 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25066 with signal TERM. Exit code 0
2013-10-31 16:15:35,470 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-14244859 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:35,481 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24852 with signal TERM. Exit code 0
2013-10-31 16:15:35,527 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0024_m_-318845689 since job job_20131031160444934_0024 is dead
2013-10-31 16:15:35,535 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25105 with signal TERM. Exit code 0
2013-10-31 16:15:35,542 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:35,542 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:35,542 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:35,542 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-2014524527 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:35,677 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:35,677 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:35,677 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:35,678 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-14244859 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:15:35,710 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:35,711 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:35,711 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:35,711 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0024_m_-318845689 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:36,006 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000006_0' has completed task_20131031160444934_0025_m_000006 successfully.
2013-10-31 16:15:36,009 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000000_0' to tip task_20131031160444934_0025_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:36,010 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000000
2013-10-31 16:15:36,011 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000001_0' to tip task_20131031160444934_0025_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:36,011 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000001
2013-10-31 16:15:36,013 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:15:36,014 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:15:36,015 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000000_0 which needs 1 slots
2013-10-31 16:15:36,015 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000000_0 which needs 1 slots
2013-10-31 16:15:36,016 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000001_0 which needs 1 slots
2013-10-31 16:15:36,016 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0025_m_000001_0 which needs 1 slots
2013-10-31 16:15:36,048 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_-741228692
2013-10-31 16:15:36,048 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_-741228692 spawned.
2013-10-31 16:15:36,049 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0025/attempt_20131031160444934_0025_m_000001_0. Attempting to reuse: jvm_20131031160444934_0025_m_-2015129647
2013-10-31 16:15:36,050 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000000_0/taskjvm.sh
2013-10-31 16:15:36,201 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000002_0' to tip task_20131031160444934_0025_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:36,202 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000002
2013-10-31 16:15:36,202 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000003_0' to tip task_20131031160444934_0025_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:36,242 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000003
2013-10-31 16:15:36,244 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:15:36,245 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:15:36,245 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000002_0 which needs 1 slots
2013-10-31 16:15:36,246 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000002_0 which needs 1 slots
2013-10-31 16:15:36,246 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000003_0 which needs 1 slots
2013-10-31 16:15:36,246 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0025_m_000003_0 which needs 1 slots
2013-10-31 16:15:36,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken dst=null perm=null
2013-10-31 16:15:36,275 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35737, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-661464544657018414_1289, duration: 285905
2013-10-31 16:15:36,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml dst=null perm=null
2013-10-31 16:15:36,287 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35808, bytes: 28946, op: HDFS_READ, cliID: DFSClient_-1875078242, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3515738870572374906_1286, duration: 413202
2013-10-31 16:15:36,308 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:36,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar dst=null perm=null
2013-10-31 16:15:36,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55845, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1875078242, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3002501081053343053_1283, duration: 594809
2013-10-31 16:15:36,373 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_331774167
2013-10-31 16:15:36,374 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_331774167 spawned.
2013-10-31 16:15:36,374 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_38283024
2013-10-31 16:15:36,375 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_38283024 spawned.
2013-10-31 16:15:36,376 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000002_0/taskjvm.sh
2013-10-31 16:15:36,376 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000003_0/taskjvm.sh
2013-10-31 16:15:36,459 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0025_m_000004_0' to tip task_20131031160444934_0025_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:15:36,459 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0025_m_000004
2013-10-31 16:15:36,461 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:15:36,461 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000004_0 which needs 1 slots
2013-10-31 16:15:36,462 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000004_0 which needs 1 slots
2013-10-31 16:15:36,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025/jobToken dst=null perm=null
2013-10-31 16:15:36,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35741, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-661464544657018414_1289, duration: 367034
2013-10-31 16:15:36,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.xml dst=null perm=null
2013-10-31 16:15:36,472 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35743, bytes: 28946, op: HDFS_READ, cliID: DFSClient_2074604822, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3515738870572374906_1286, duration: 386115
2013-10-31 16:15:36,490 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:36,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.jar dst=null perm=null
2013-10-31 16:15:36,510 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48846, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2074604822, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3002501081053343053_1283, duration: 570588
2013-10-31 16:15:36,517 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-2015129647 given task: attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:36,563 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0025_m_-922718880
2013-10-31 16:15:36,564 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0025_m_-922718880 spawned.
2013-10-31 16:15:36,565 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0025/attempt_20131031160444934_0025_m_000004_0/taskjvm.sh
2013-10-31 16:15:36,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=null
2013-10-31 16:15:36,783 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48848, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7897376192076226208_1284, duration: 170494
2013-10-31 16:15:36,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:36,824 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35747, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 134741
2013-10-31 16:15:36,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:36,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:37,062 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-741228692 given task: attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:37,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=null
2013-10-31 16:15:37,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:37,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:37,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:37,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:37,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:37,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:37,116 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55854, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2623433961007257862_1277, duration: 129401
2013-10-31 16:15:37,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:37,133 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55855, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 105650
2013-10-31 16:15:37,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:37,136 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55856, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7985283914289950420_1279, duration: 99143
2013-10-31 16:15:37,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:37,139 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35821, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 98860
2013-10-31 16:15:37,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:37,142 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35822, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 139118
2013-10-31 16:15:37,151 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001. blk_-6384772226567960736_1290
2013-10-31 16:15:37,167 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6384772226567960736_1290 src: /127.0.0.1:48856 dest: /127.0.0.1:47311
2013-10-31 16:15:37,168 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6384772226567960736_1290 src: /127.0.0.1:35824 dest: /127.0.0.1:38271
2013-10-31 16:15:37,169 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6384772226567960736_1290 src: /127.0.0.1:35756 dest: /127.0.0.1:50942
2013-10-31 16:15:37,172 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35756, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6384772226567960736_1290, duration: 1712921
2013-10-31 16:15:37,172 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6384772226567960736_1290 terminating
2013-10-31 16:15:37,172 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35824, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6384772226567960736_1290, duration: 2193821
2013-10-31 16:15:37,172 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6384772226567960736_1290 terminating
2013-10-31 16:15:37,172 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48856, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6384772226567960736_1290, duration: 2594604
2013-10-31 16:15:37,173 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6384772226567960736_1290 terminating
2013-10-31 16:15:37,173 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6384772226567960736_1290 size 12
2013-10-31 16:15:37,175 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6384772226567960736_1290 size 12
2013-10-31 16:15:37,175 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:37,175 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:37,175 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6384772226567960736_1290 size 12
2013-10-31 16:15:37,216 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:37,216 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000001_0 0.0%
2013-10-31 16:15:37,363 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_331774167 given task: attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:37,514 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_38283024 given task: attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:37,544 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_-922718880 given task: attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:37,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=null
2013-10-31 16:15:37,569 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48863, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7897376192076226208_1284, duration: 173000
2013-10-31 16:15:37,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:37,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:37,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:37,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=null
2013-10-31 16:15:37,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:37,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:37,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:37,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:37,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:37,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:37,852 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35832, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 147639
2013-10-31 16:15:37,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=null
2013-10-31 16:15:37,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:37,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35833, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2558601193971908172_1278, duration: 104875
2013-10-31 16:15:37,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:37,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35834, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7985283914289950420_1279, duration: 105233
2013-10-31 16:15:37,874 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35766, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 148281
2013-10-31 16:15:37,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:37,875 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35767, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1719649238952092533_1281, duration: 99610
2013-10-31 16:15:37,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:37,878 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35837, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 100435
2013-10-31 16:15:37,881 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55874, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 108871
2013-10-31 16:15:37,888 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000. blk_1107000733830591378_1291
2013-10-31 16:15:37,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107000733830591378_1291 src: /127.0.0.1:55875 dest: /127.0.0.1:41648
2013-10-31 16:15:37,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107000733830591378_1291 src: /127.0.0.1:35840 dest: /127.0.0.1:38271
2013-10-31 16:15:37,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:37,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107000733830591378_1291 src: /127.0.0.1:35772 dest: /127.0.0.1:50942
2013-10-31 16:15:37,913 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35773, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 113741
2013-10-31 16:15:37,914 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35772, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1107000733830591378_1291, duration: 1298013
2013-10-31 16:15:37,914 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1107000733830591378_1291 terminating
2013-10-31 16:15:37,914 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35840, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1107000733830591378_1291, duration: 1407364
2013-10-31 16:15:37,914 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1107000733830591378_1291 terminating
2013-10-31 16:15:37,914 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55875, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1107000733830591378_1291, duration: 1817485
2013-10-31 16:15:37,915 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1107000733830591378_1291 terminating
2013-10-31 16:15:37,915 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1107000733830591378_1291 size 12
2013-10-31 16:15:37,916 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:37,916 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:37,916 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1107000733830591378_1291 size 12
2013-10-31 16:15:37,916 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1107000733830591378_1291 size 12
2013-10-31 16:15:37,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:37,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:37,965 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:37,965 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000000_0 0.0%
2013-10-31 16:15:38,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=null
2013-10-31 16:15:38,023 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35776, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 172026
2013-10-31 16:15:38,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025/job.split dst=null perm=null
2013-10-31 16:15:38,045 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35777, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7897376192076226208_1284, duration: 167826
2013-10-31 16:15:38,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:38,062 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35778, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 99938
2013-10-31 16:15:38,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:38,085 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35779, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 212004
2013-10-31 16:15:38,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=null
2013-10-31 16:15:38,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:38,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:38,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:38,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:38,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:38,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:38,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:38,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:38,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:38,335 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35780, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2623433961007257862_1277, duration: 278199
2013-10-31 16:15:38,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:38,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:38,354 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55886, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 258702
2013-10-31 16:15:38,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:38,358 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35782, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7985283914289950420_1279, duration: 251675
2013-10-31 16:15:38,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:38,362 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55888, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1719649238952092533_1281, duration: 251251
2013-10-31 16:15:38,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:38,367 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55889, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8601652280056973022_1281, duration: 278016
2013-10-31 16:15:38,376 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002. blk_9211691514110189620_1294
2013-10-31 16:15:38,399 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9211691514110189620_1294 src: /127.0.0.1:35854 dest: /127.0.0.1:38271
2013-10-31 16:15:38,400 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9211691514110189620_1294 src: /127.0.0.1:48888 dest: /127.0.0.1:47311
2013-10-31 16:15:38,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9211691514110189620_1294 src: /127.0.0.1:55892 dest: /127.0.0.1:41648
2013-10-31 16:15:38,405 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55892, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_9211691514110189620_1294, duration: 1585353
2013-10-31 16:15:38,405 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9211691514110189620_1294 terminating
2013-10-31 16:15:38,405 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48888, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_9211691514110189620_1294, duration: 2740011
2013-10-31 16:15:38,405 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9211691514110189620_1294 terminating
2013-10-31 16:15:38,406 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35854, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9211691514110189620_1294, duration: 3163112
2013-10-31 16:15:38,406 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9211691514110189620_1294 terminating
2013-10-31 16:15:38,406 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_9211691514110189620_1294 size 12
2013-10-31 16:15:38,407 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:38,407 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:38,409 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_9211691514110189620_1294 size 12
2013-10-31 16:15:38,409 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_9211691514110189620_1294 size 12
2013-10-31 16:15:38,453 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:38,454 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000002_0 0.0%
2013-10-31 16:15:38,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=null
2013-10-31 16:15:38,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:38,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=null
2013-10-31 16:15:38,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:38,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:38,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:38,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:38,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:38,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:38,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:38,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:38,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:38,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:38,563 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35857, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 122476
2013-10-31 16:15:38,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00000 dst=null perm=null
2013-10-31 16:15:38,568 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35858, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2623433961007257862_1277, duration: 134804
2013-10-31 16:15:38,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:38,580 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55895, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2558601193971908172_1278, duration: 103235
2013-10-31 16:15:38,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:38,583 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35860, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7985283914289950420_1279, duration: 99742
2013-10-31 16:15:38,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00001 dst=null perm=null
2013-10-31 16:15:38,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:38,585 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48894, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2558601193971908172_1278, duration: 108694
2013-10-31 16:15:38,586 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35862, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 106205
2013-10-31 16:15:38,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00002 dst=null perm=null
2013-10-31 16:15:38,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:38,588 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35794, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7985283914289950420_1279, duration: 98490
2013-10-31 16:15:38,588 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55900, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8601652280056973022_1281, duration: 100773
2013-10-31 16:15:38,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00003 dst=null perm=null
2013-10-31 16:15:38,590 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35865, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1719649238952092533_1281, duration: 120892
2013-10-31 16:15:38,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F/part-00004 dst=null perm=null
2013-10-31 16:15:38,593 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35866, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8601652280056973022_1281, duration: 98125
2013-10-31 16:15:38,597 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004. blk_-8824242536225630163_1294
2013-10-31 16:15:38,603 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003. blk_-4243449972058944542_1294
2013-10-31 16:15:38,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8824242536225630163_1294 src: /127.0.0.1:35867 dest: /127.0.0.1:38271
2013-10-31 16:15:38,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8824242536225630163_1294 src: /127.0.0.1:35800 dest: /127.0.0.1:50942
2013-10-31 16:15:38,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8824242536225630163_1294 src: /127.0.0.1:48903 dest: /127.0.0.1:47311
2013-10-31 16:15:38,623 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48903, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8824242536225630163_1294, duration: 1240950
2013-10-31 16:15:38,623 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8824242536225630163_1294 terminating
2013-10-31 16:15:38,624 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35800, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8824242536225630163_1294, duration: 1347284
2013-10-31 16:15:38,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8824242536225630163_1294 terminating
2013-10-31 16:15:38,624 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35867, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 1724363
2013-10-31 16:15:38,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8824242536225630163_1294 terminating
2013-10-31 16:15:38,624 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8824242536225630163_1294 size 12
2013-10-31 16:15:38,625 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:38,625 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:38,626 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8824242536225630163_1294 size 12
2013-10-31 16:15:38,627 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8824242536225630163_1294 size 12
2013-10-31 16:15:38,635 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4243449972058944542_1294 src: /127.0.0.1:55904 dest: /127.0.0.1:41648
2013-10-31 16:15:38,636 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4243449972058944542_1294 src: /127.0.0.1:48904 dest: /127.0.0.1:47311
2013-10-31 16:15:38,637 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4243449972058944542_1294 src: /127.0.0.1:35803 dest: /127.0.0.1:50942
2013-10-31 16:15:38,638 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35803, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4243449972058944542_1294, duration: 957122
2013-10-31 16:15:38,639 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4243449972058944542_1294 terminating
2013-10-31 16:15:38,639 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48904, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4243449972058944542_1294, duration: 1324621
2013-10-31 16:15:38,639 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4243449972058944542_1294 terminating
2013-10-31 16:15:38,639 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55904, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0025_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4243449972058944542_1294, duration: 1787337
2013-10-31 16:15:38,640 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4243449972058944542_1294 terminating
2013-10-31 16:15:38,642 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4243449972058944542_1294 size 12
2013-10-31 16:15:38,642 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4243449972058944542_1294 size 12
2013-10-31 16:15:38,643 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4243449972058944542_1294 size 12
2013-10-31 16:15:38,670 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:38,670 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000004_0 0.0%
2013-10-31 16:15:39,018 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000000_0
2013-10-31 16:15:39,018 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000001_0
2013-10-31 16:15:39,041 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:39,042 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:39,108 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0025_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:15:39,108 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000003_0 0.0%
2013-10-31 16:15:39,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0 dst=null perm=null
2013-10-31 16:15:39,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:39,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000001_0 dst=null perm=null
2013-10-31 16:15:39,252 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000002_0
2013-10-31 16:15:39,252 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000003_0
2013-10-31 16:15:39,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0 dst=null perm=null
2013-10-31 16:15:39,465 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0025_m_000004_0
2013-10-31 16:15:39,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:39,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000002_0 dst=null perm=null
2013-10-31 16:15:39,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0 dst=null perm=null
2013-10-31 16:15:39,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:39,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000004_0 dst=null perm=null
2013-10-31 16:15:39,747 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:15:39,748 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000001_0 is done.
2013-10-31 16:15:39,748 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000001_0 was -1
2013-10-31 16:15:39,749 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:39,847 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:15:39,861 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,867 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,872 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,878 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,883 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,888 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:15:39,888 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:15:39,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0 dst=null perm=null
2013-10-31 16:15:39,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:39,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:40,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0 dst=null perm=null
2013-10-31 16:15:40,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:40,801 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:15:40,803 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000002_0 is done.
2013-10-31 16:15:40,803 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000002_0 was -1
2013-10-31 16:15:40,803 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:15:40,972 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:15:40,975 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000004_0 is done.
2013-10-31 16:15:40,975 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000004_0 was -1
2013-10-31 16:15:40,975 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:41,015 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0025_m_000006_0
2013-10-31 16:15:41,015 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0025_m_000006_0
2013-10-31 16:15:41,015 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000006_0 not found in cache
2013-10-31 16:15:41,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000000_0 dst=null perm=null
2013-10-31 16:15:41,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:41,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/_attempt_20131031160444934_0025_m_000003_0 dst=null perm=null
2013-10-31 16:15:42,021 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000001_0' has completed task_20131031160444934_0025_m_000001 successfully.
2013-10-31 16:15:42,256 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000002_0' has completed task_20131031160444934_0025_m_000002 successfully.
2013-10-31 16:15:42,468 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000004_0' has completed task_20131031160444934_0025_m_000004 successfully.
2013-10-31 16:15:43,567 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:15:43,574 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:15:43,575 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000000_0 is done.
2013-10-31 16:15:43,575 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000000_0 was -1
2013-10-31 16:15:43,575 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:44,003 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:15:44,007 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:15:44,007 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000003_0 is done.
2013-10-31 16:15:44,007 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000003_0 was -1
2013-10-31 16:15:44,008 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:45,027 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000000_0' has completed task_20131031160444934_0025_m_000000 successfully.
2013-10-31 16:15:45,260 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000003_0' has completed task_20131031160444934_0025_m_000003 successfully.
2013-10-31 16:15:45,263 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0025_m_000005_0' to tip task_20131031160444934_0025_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:15:45,265 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0025_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:15:45,266 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0025_m_000005_0 which needs 1 slots
2013-10-31 16:15:45,266 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0025_m_000005_0 which needs 1 slots
2013-10-31 16:15:45,303 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0025/attempt_20131031160444934_0025_m_000005_0. Attempting to reuse: jvm_20131031160444934_0025_m_331774167
2013-10-31 16:15:45,859 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0025_m_331774167 given task: attempt_20131031160444934_0025_m_000005_0
2013-10-31 16:15:45,979 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000005_0 0.0%
2013-10-31 16:15:45,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary dst=null perm=null
2013-10-31 16:15:45,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:45,992 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS from client DFSClient_attempt_20131031160444934_0025_m_000005_0
2013-10-31 16:15:45,992 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0025_m_000005_0
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3002501081053343053 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7897376192076226208 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3800742364459467549 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3800742364459467549 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3800742364459467549 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,997 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3515738870572374906 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:45,998 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3515738870572374906 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:45,998 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3515738870572374906 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:46,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0025 dst=null perm=null
2013-10-31 16:15:48,296 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-3002501081053343053_1283 blk_-7897376192076226208_1284 blk_-3800742364459467549_1285
2013-10-31 16:15:48,296 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_3515738870572374906_1286 blk_-3002501081053343053_1283 blk_-7897376192076226208_1284
2013-10-31 16:15:48,953 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0025_m_000005_0 0.0% cleanup
2013-10-31 16:15:48,954 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0025_m_000005_0 is done.
2013-10-31 16:15:48,955 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0025_m_000005_0 was -1
2013-10-31 16:15:48,955 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:15:49,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data6/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:49,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3800742364459467549_1285 file build/test/data/dfs/data/data5/current/blk_-3800742364459467549 for deletion
2013-10-31 16:15:49,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data5/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:49,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data6/current/blk_-7897376192076226208
2013-10-31 16:15:49,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3800742364459467549_1285 at file build/test/data/dfs/data/data5/current/blk_-3800742364459467549
2013-10-31 16:15:49,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data5/current/blk_-3002501081053343053
2013-10-31 16:15:51,055 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data8/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:51,055 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data8/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:51,055 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data8/current/blk_-7897376192076226208
2013-10-31 16:15:51,055 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3515738870572374906_1286 file build/test/data/dfs/data/data7/current/blk_3515738870572374906 for deletion
2013-10-31 16:15:51,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data8/current/blk_-3002501081053343053
2013-10-31 16:15:51,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3515738870572374906_1286 at file build/test/data/dfs/data/data7/current/blk_3515738870572374906
2013-10-31 16:15:51,273 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0025_m_000005_0' has completed task_20131031160444934_0025_m_000005 successfully.
2013-10-31 16:15:51,274 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0025 has completed successfully.
2013-10-31 16:15:51,275 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0025,submitTime=1383236127640,launchTime=1383236128398,firstMapTaskLaunchTime=1383236136009,firstJobSetupTaskLaunchTime=1383236129993,firstJobCleanupTaskLaunchTime=1383236145263,finishTime=1383236151274,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=36,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[ED56FF6D03804A6891662367F6814562/892D735750CD47CD9D9AA0A84906AB6F] upper2*lower*upper1/(1/2) ...orm/joinaroundjoinswapped
2013-10-31 16:15:51,280 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD. blk_-8290491646553836876_1295
2013-10-31 16:15:51,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8290491646553836876_1295 src: /127.0.0.1:55911 dest: /127.0.0.1:41648
2013-10-31 16:15:51,284 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8290491646553836876_1295 src: /127.0.0.1:35807 dest: /127.0.0.1:50942
2013-10-31 16:15:51,286 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8290491646553836876_1295 src: /127.0.0.1:35877 dest: /127.0.0.1:38271
2013-10-31 16:15:51,295 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35877, dest: /127.0.0.1:38271, bytes: 26367, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8290491646553836876_1295, duration: 6026670
2013-10-31 16:15:51,296 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8290491646553836876_1295 terminating
2013-10-31 16:15:51,296 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35807, dest: /127.0.0.1:50942, bytes: 26367, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8290491646553836876_1295, duration: 3941232
2013-10-31 16:15:51,297 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8290491646553836876_1295 terminating
2013-10-31 16:15:51,297 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_3515738870572374906_1286 blk_-3002501081053343053_1283 blk_-7897376192076226208_1284 blk_-3800742364459467549_1285
2013-10-31 16:15:51,297 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55911, dest: /127.0.0.1:41648, bytes: 26367, op: HDFS_WRITE, cliID: DFSClient_-460164648, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8290491646553836876_1295, duration: 6880173
2013-10-31 16:15:51,297 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8290491646553836876_1295 size 26367
2013-10-31 16:15:51,298 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8290491646553836876_1295 terminating
2013-10-31 16:15:51,300 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_3515738870572374906_1286 blk_-3002501081053343053_1283 blk_-7897376192076226208_1284 blk_-3800742364459467549_1285
2013-10-31 16:15:51,301 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD from client DFSClient_-460164648
2013-10-31 16:15:51,301 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_logs/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD is closed by DFSClient_-460164648
2013-10-31 16:15:51,302 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8290491646553836876_1295 size 26367
2013-10-31 16:15:51,302 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8290491646553836876_1295 size 26367
2013-10-31 16:15:51,309 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0025_1383236127640_hadoop_%5BED56FF6D03804A6891662367F6814562%2F892D735750CD47CD to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:51,309 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000002_0'
2013-10-31 16:15:51,310 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000003_0'
2013-10-31 16:15:51,310 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000005_0'
2013-10-31 16:15:51,311 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-661464544657018414 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,311 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-661464544657018414 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,311 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-661464544657018414 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,315 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0025_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:15:51,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0025 dst=null perm=null
2013-10-31 16:15:51,317 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-750470584501963121 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,317 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-750470584501963121 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-750470584501963121 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8206799160724257515 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8206799160724257515 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8206799160724257515 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,318 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2623433961007257862 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,319 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2623433961007257862 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,319 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2623433961007257862 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,319 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2558601193971908172 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,319 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2558601193971908172 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,320 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2558601193971908172 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:15:51,320 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7985283914289950420 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,320 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7985283914289950420 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,320 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7985283914289950420 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,320 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1719649238952092533 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,321 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1719649238952092533 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,321 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1719649238952092533 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,321 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8601652280056973022 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:15:51,321 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8601652280056973022 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:15:51,321 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8601652280056973022 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:15:51,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1543464979_lower_upper1_6E06665F0D1947DCBD39C030C4A3835F dst=null perm=null
2013-10-31 16:15:51,329 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary
2013-10-31 16:15:51,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2013-10-31 16:15:51,349 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:51,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2013-10-31 16:15:51,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2013-10-31 16:15:51,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2013-10-31 16:15:51,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2013-10-31 16:15:51,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2013-10-31 16:15:51,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2013-10-31 16:15:51,359 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55915, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1107000733830591378_1291, duration: 779600
2013-10-31 16:15:51,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2013-10-31 16:15:51,364 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48913, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6384772226567960736_1290, duration: 259398
2013-10-31 16:15:51,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2013-10-31 16:15:51,367 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48914, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_9211691514110189620_1294, duration: 271068
2013-10-31 16:15:51,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2013-10-31 16:15:51,370 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55918, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4243449972058944542_1294, duration: 267624
2013-10-31 16:15:51,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2013-10-31 16:15:51,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35883, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 264888
2013-10-31 16:15:51,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2013-10-31 16:15:51,391 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:15:51,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2013-10-31 16:15:51,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2013-10-31 16:15:51,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2013-10-31 16:15:51,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2013-10-31 16:15:51,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2013-10-31 16:15:51,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2013-10-31 16:15:51,401 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35884, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1107000733830591378_1291, duration: 268078
2013-10-31 16:15:51,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2013-10-31 16:15:51,404 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35885, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6384772226567960736_1290, duration: 265876
2013-10-31 16:15:51,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2013-10-31 16:15:51,407 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35886, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_9211691514110189620_1294, duration: 265869
2013-10-31 16:15:51,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2013-10-31 16:15:51,410 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48920, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4243449972058944542_1294, duration: 263367
2013-10-31 16:15:51,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2013-10-31 16:15:51,413 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35888, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 262104
2013-10-31 16:15:51,413 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinaroundjoinswapped
2013-10-31 16:15:51,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2013-10-31 16:15:51,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2013-10-31 16:15:51,422 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35820, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1107000733830591378_1291, duration: 257268
2013-10-31 16:15:51,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2013-10-31 16:15:51,426 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35890, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6384772226567960736_1290, duration: 264508
2013-10-31 16:15:51,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2013-10-31 16:15:51,430 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55927, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_9211691514110189620_1294, duration: 264304
2013-10-31 16:15:51,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2013-10-31 16:15:51,434 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55928, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4243449972058944542_1294, duration: 260466
2013-10-31 16:15:51,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2013-10-31 16:15:51,439 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35893, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8824242536225630163_1294, duration: 291504
2013-10-31 16:15:51,445 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data4/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:51,445 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3800742364459467549_1285 file build/test/data/dfs/data/data3/current/blk_-3800742364459467549 for deletion
2013-10-31 16:15:51,446 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data4/current/blk_-7897376192076226208
2013-10-31 16:15:51,446 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data3/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:51,446 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3800742364459467549_1285 at file build/test/data/dfs/data/data3/current/blk_-3800742364459467549
2013-10-31 16:15:51,447 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3515738870572374906_1286 file build/test/data/dfs/data/data4/current/blk_3515738870572374906 for deletion
2013-10-31 16:15:51,447 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data3/current/blk_-3002501081053343053
2013-10-31 16:15:51,447 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3515738870572374906_1286 at file build/test/data/dfs/data/data4/current/blk_3515738870572374906
2013-10-31 16:15:51,462 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:15:51,462 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:15:51,477 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:51,477 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0025 being deleted.
2013-10-31 16:15:51,478 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000004_0'
2013-10-31 16:15:51,479 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:15:51,479 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:15:51,480 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:15:51,480 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch"]
2013-10-31 16:15:51,480 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:15:51,480 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 2
2013-10-31 16:15:51,480 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 2
2013-10-31 16:15:51,481 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (2/2)
2013-10-31 16:15:51,484 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:15:51,484 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:15:51,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:51,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:15:51,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,505 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar. blk_-5219485888681558172_1296
2013-10-31 16:15:51,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:35825 dest: /127.0.0.1:50942
2013-10-31 16:15:51,508 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:48928 dest: /127.0.0.1:47311
2013-10-31 16:15:51,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:35896 dest: /127.0.0.1:38271
2013-10-31 16:15:51,521 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35896, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5219485888681558172_1296, duration: 7555322
2013-10-31 16:15:51,522 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5219485888681558172_1296 terminating
2013-10-31 16:15:51,522 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48928, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5219485888681558172_1296, duration: 8421542
2013-10-31 16:15:51,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5219485888681558172_1296 terminating
2013-10-31 16:15:51,523 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35825, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5219485888681558172_1296, duration: 9319880
2013-10-31 16:15:51,524 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5219485888681558172_1296 terminating
2013-10-31 16:15:51,524 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:51,526 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar from client DFSClient_1457307213
2013-10-31 16:15:51,527 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar is closed by DFSClient_1457307213
2013-10-31 16:15:51,527 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:51,528 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:51,534 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar. New replication is 10
2013-10-31 16:15:51,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar dst=null perm=null
2013-10-31 16:15:51,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,548 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:15:51,553 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:15:51,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:15:51,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:51,568 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split. New replication is 10
2013-10-31 16:15:51,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=null
2013-10-31 16:15:51,575 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split. blk_-1998638381933410712_1297
2013-10-31 16:15:51,577 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:35897 dest: /127.0.0.1:38271
2013-10-31 16:15:51,578 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:35829 dest: /127.0.0.1:50942
2013-10-31 16:15:51,580 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:48932 dest: /127.0.0.1:47311
2013-10-31 16:15:51,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1998638381933410712_1297 src: /127.0.0.1:55936 dest: /127.0.0.1:41648
2013-10-31 16:15:51,585 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55936, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1998638381933410712_1297, duration: 1286489
2013-10-31 16:15:51,586 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,587 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,589 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48932, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1998638381933410712_1297, duration: 146101
2013-10-31 16:15:51,589 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,591 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,591 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35829, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1998638381933410712_1297, duration: 167957
2013-10-31 16:15:51,592 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,592 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35897, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1998638381933410712_1297, duration: 3333834
2013-10-31 16:15:51,593 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1998638381933410712_1297 terminating
2013-10-31 16:15:51,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,603 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split from client DFSClient_1457307213
2013-10-31 16:15:51,603 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split is closed by DFSClient_1457307213
2013-10-31 16:15:51,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1998638381933410712_1297 size 1732
2013-10-31 16:15:51,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,112 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo. blk_3074485234667118697_1298
2013-10-31 16:15:52,114 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3074485234667118697_1298 src: /127.0.0.1:35832 dest: /127.0.0.1:50942
2013-10-31 16:15:52,116 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3074485234667118697_1298 src: /127.0.0.1:48935 dest: /127.0.0.1:47311
2013-10-31 16:15:52,118 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3074485234667118697_1298 src: /127.0.0.1:55939 dest: /127.0.0.1:41648
2013-10-31 16:15:52,120 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55939, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3074485234667118697_1298, duration: 70270
2013-10-31 16:15:52,121 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3074485234667118697_1298 terminating
2013-10-31 16:15:52,121 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3074485234667118697_1298 size 183
2013-10-31 16:15:52,121 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48935, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3074485234667118697_1298, duration: 928229
2013-10-31 16:15:52,122 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3074485234667118697_1298 terminating
2013-10-31 16:15:52,122 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35832, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3074485234667118697_1298, duration: 2049635
2013-10-31 16:15:52,123 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3074485234667118697_1298 terminating
2013-10-31 16:15:52,126 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3074485234667118697_1298 size 183
2013-10-31 16:15:52,127 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:15:52,127 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:15:52,127 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3074485234667118697_1298 size 183
2013-10-31 16:15:52,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,151 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml. blk_-754354625884155761_1299
2013-10-31 16:15:52,152 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-754354625884155761_1299 src: /127.0.0.1:35835 dest: /127.0.0.1:50942
2013-10-31 16:15:52,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-754354625884155761_1299 src: /127.0.0.1:55941 dest: /127.0.0.1:41648
2013-10-31 16:15:52,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-754354625884155761_1299 src: /127.0.0.1:48939 dest: /127.0.0.1:47311
2013-10-31 16:15:52,159 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48939, dest: /127.0.0.1:47311, bytes: 28168, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 181407
2013-10-31 16:15:52,159 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-754354625884155761_1299 terminating
2013-10-31 16:15:52,160 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55941, dest: /127.0.0.1:41648, bytes: 28168, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-754354625884155761_1299, duration: 1020229
2013-10-31 16:15:52,160 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-754354625884155761_1299 terminating
2013-10-31 16:15:52,160 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35835, dest: /127.0.0.1:50942, bytes: 28168, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-754354625884155761_1299, duration: 1884575
2013-10-31 16:15:52,161 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-754354625884155761_1299 terminating
2013-10-31 16:15:52,164 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-754354625884155761_1299 size 28168
2013-10-31 16:15:52,164 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-754354625884155761_1299 size 28168
2013-10-31 16:15:52,165 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-754354625884155761_1299 size 28168
2013-10-31 16:15:52,564 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml from client DFSClient_1457307213
2013-10-31 16:15:52,565 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml is closed by DFSClient_1457307213
2013-10-31 16:15:52,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml dst=null perm=null
2013-10-31 16:15:52,579 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48941, bytes: 28392, op: HDFS_READ, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 388571
2013-10-31 16:15:52,597 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0026: nMaps=5 nReduces=1 max=-1
2013-10-31 16:15:52,598 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0026 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:15:52,598 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0026
2013-10-31 16:15:52,598 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0026 RESULT=SUCCESS
2013-10-31 16:15:52,598 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0026
2013-10-31 16:15:52,599 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0026
2013-10-31 16:15:52,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,630 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml. blk_-7019503529854675644_1301
2013-10-31 16:15:52,631 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7019503529854675644_1301 src: /127.0.0.1:48942 dest: /127.0.0.1:47311
2013-10-31 16:15:52,632 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7019503529854675644_1301 src: /127.0.0.1:55946 dest: /127.0.0.1:41648
2013-10-31 16:15:52,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7019503529854675644_1301 src: /127.0.0.1:35911 dest: /127.0.0.1:38271
2013-10-31 16:15:52,636 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35911, dest: /127.0.0.1:38271, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7019503529854675644_1301, duration: 88306
2013-10-31 16:15:52,636 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7019503529854675644_1301 terminating
2013-10-31 16:15:52,636 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:55946, dest: /127.0.0.1:41648, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7019503529854675644_1301, duration: 920579
2013-10-31 16:15:52,637 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7019503529854675644_1301 terminating
2013-10-31 16:15:52,637 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7019503529854675644_1301 size 28233
2013-10-31 16:15:52,637 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48942, dest: /127.0.0.1:47311, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7019503529854675644_1301, duration: 1872853
2013-10-31 16:15:52,638 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7019503529854675644_1301 terminating
2013-10-31 16:15:52,639 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml from client DFSClient_311566579
2013-10-31 16:15:52,640 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_conf.xml is closed by DFSClient_311566579
2013-10-31 16:15:52,640 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7019503529854675644_1301 size 28233
2013-10-31 16:15:52,641 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7019503529854675644_1301 size 28233
2013-10-31 16:15:52,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:15:52,652 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken. blk_-3603487056913048693_1302
2013-10-31 16:15:52,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3603487056913048693_1302 src: /127.0.0.1:48945 dest: /127.0.0.1:47311
2013-10-31 16:15:52,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3603487056913048693_1302 src: /127.0.0.1:35913 dest: /127.0.0.1:38271
2013-10-31 16:15:52,655 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3603487056913048693_1302 src: /127.0.0.1:35845 dest: /127.0.0.1:50942
2013-10-31 16:15:52,656 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35845, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3603487056913048693_1302, duration: 712590
2013-10-31 16:15:52,657 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3603487056913048693_1302 terminating
2013-10-31 16:15:52,657 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35913, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3603487056913048693_1302, duration: 399884
2013-10-31 16:15:52,657 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3603487056913048693_1302 terminating
2013-10-31 16:15:52,657 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48945, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3603487056913048693_1302, duration: 802040
2013-10-31 16:15:52,658 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3603487056913048693_1302 terminating
2013-10-31 16:15:52,658 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3603487056913048693_1302 size 116
2013-10-31 16:15:52,660 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken from client DFSClient_1457307213
2013-10-31 16:15:52,660 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken is closed by DFSClient_1457307213
2013-10-31 16:15:52,661 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3603487056913048693_1302 size 116
2013-10-31 16:15:52,662 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3603487056913048693_1302 size 116
2013-10-31 16:15:52,664 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken
2013-10-31 16:15:52,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.splitmetainfo dst=null perm=null
2013-10-31 16:15:52,666 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48948, bytes: 187, op: HDFS_READ, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3074485234667118697_1298, duration: 279282
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0026 = 19. Number of splits = 5
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,667 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0026_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:15:52,668 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0026 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:15:52,669 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0026 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:15:53,846 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7897376192076226208_1284 file build/test/data/dfs/data/data1/current/blk_-7897376192076226208 for deletion
2013-10-31 16:15:53,846 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3800742364459467549_1285 file build/test/data/dfs/data/data2/current/blk_-3800742364459467549 for deletion
2013-10-31 16:15:53,846 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7897376192076226208_1284 at file build/test/data/dfs/data/data1/current/blk_-7897376192076226208
2013-10-31 16:15:53,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3800742364459467549_1285 at file build/test/data/dfs/data/data2/current/blk_-3800742364459467549
2013-10-31 16:15:53,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3002501081053343053_1283 file build/test/data/dfs/data/data2/current/blk_-3002501081053343053 for deletion
2013-10-31 16:15:53,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3515738870572374906_1286 file build/test/data/dfs/data/data1/current/blk_3515738870572374906 for deletion
2013-10-31 16:15:53,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3002501081053343053_1283 at file build/test/data/dfs/data/data2/current/blk_-3002501081053343053
2013-10-31 16:15:53,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3515738870572374906_1286 at file build/test/data/dfs/data/data1/current/blk_3515738870572374906
2013-10-31 16:15:54,040 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0026_m_000006_0' to tip task_20131031160444934_0026_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:15:54,045 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000000_0'
2013-10-31 16:15:54,046 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000001_0'
2013-10-31 16:15:54,046 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0025_m_000006_0'
2013-10-31 16:15:54,048 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:15:54,048 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000006_0 which needs 1 slots
2013-10-31 16:15:54,048 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000006_0 which needs 1 slots
2013-10-31 16:15:54,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken dst=null perm=null
2013-10-31 16:15:54,057 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35916, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3603487056913048693_1302, duration: 290900
2013-10-31 16:15:54,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml dst=null perm=null
2013-10-31 16:15:54,067 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48951, bytes: 28392, op: HDFS_READ, cliID: DFSClient_716493604, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 421913
2013-10-31 16:15:54,094 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:15:54,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar dst=null perm=null
2013-10-31 16:15:54,127 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35919, bytes: 239915, op: HDFS_READ, cliID: DFSClient_716493604, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5219485888681558172_1296, duration: 1540877
2013-10-31 16:15:54,221 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0025_m_-741228692
2013-10-31 16:15:54,227 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25634 with signal TERM. Exit code 0
2013-10-31 16:15:54,228 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_-1242438880
2013-10-31 16:15:54,229 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_-1242438880 spawned.
2013-10-31 16:15:54,230 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000006_0/taskjvm.sh
2013-10-31 16:15:54,301 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-5219485888681558172_1296 to datanode(s) 127.0.0.1:41648
2013-10-31 16:15:54,302 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-661464544657018414_1289 blk_-8601652280056973022_1281 blk_8206799160724257515_1275 blk_1719649238952092533_1281 blk_2623433961007257862_1277 blk_-7985283914289950420_1279
2013-10-31 16:15:54,302 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-750470584501963121_1282 blk_-661464544657018414_1289 blk_-8601652280056973022_1281 blk_8206799160724257515_1275 blk_1719649238952092533_1281 blk_2623433961007257862_1277 blk_-7985283914289950420_1279 blk_2558601193971908172_1278
2013-10-31 16:15:54,446 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-5219485888681558172_1296 to 127.0.0.1:41648
2013-10-31 16:15:54,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5219485888681558172_1296 src: /127.0.0.1:55956 dest: /127.0.0.1:41648
2013-10-31 16:15:54,448 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-5219485888681558172_1296 to /127.0.0.1:41648
2013-10-31 16:15:54,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5219485888681558172_1296 src: /127.0.0.1:55956 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:15:54,455 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5219485888681558172_1296 size 238055
2013-10-31 16:15:54,606 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0025_m_-741228692
2013-10-31 16:15:56,312 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:56,312 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000005_0 not found in cache
2013-10-31 16:15:56,312 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000002_0 not found in cache
2013-10-31 16:15:56,312 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000003_0 not found in cache
2013-10-31 16:15:56,313 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0025 for user-log deletion with retainTimeStamp:1383322556313
2013-10-31 16:15:56,480 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:56,480 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000004_0 not found in cache
2013-10-31 16:15:56,481 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0025 for user-log deletion with retainTimeStamp:1383322556481
2013-10-31 16:15:56,542 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_-922718880 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:56,546 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_38283024 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:56,553 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25774 with signal TERM. Exit code 0
2013-10-31 16:15:56,557 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25745 with signal TERM. Exit code 0
2013-10-31 16:15:56,724 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:56,724 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:56,725 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:56,725 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_38283024 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:56,742 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:56,742 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:56,742 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:56,742 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_-922718880 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:56,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8601652280056973022_1281 file build/test/data/dfs/data/data2/current/blk_-8601652280056973022 for deletion
2013-10-31 16:15:56,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7985283914289950420_1279 file build/test/data/dfs/data/data2/current/blk_-7985283914289950420 for deletion
2013-10-31 16:15:56,847 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8601652280056973022_1281 at file build/test/data/dfs/data/data2/current/blk_-8601652280056973022
2013-10-31 16:15:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-750470584501963121_1282 file build/test/data/dfs/data/data1/current/blk_-750470584501963121 for deletion
2013-10-31 16:15:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7985283914289950420_1279 at file build/test/data/dfs/data/data2/current/blk_-7985283914289950420
2013-10-31 16:15:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-661464544657018414_1289 file build/test/data/dfs/data/data2/current/blk_-661464544657018414 for deletion
2013-10-31 16:15:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-750470584501963121_1282 at file build/test/data/dfs/data/data1/current/blk_-750470584501963121
2013-10-31 16:15:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-661464544657018414_1289 at file build/test/data/dfs/data/data2/current/blk_-661464544657018414
2013-10-31 16:15:56,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1719649238952092533_1281 file build/test/data/dfs/data/data1/current/blk_1719649238952092533 for deletion
2013-10-31 16:15:56,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2558601193971908172_1278 file build/test/data/dfs/data/data1/current/blk_2558601193971908172 for deletion
2013-10-31 16:15:56,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1719649238952092533_1281 at file build/test/data/dfs/data/data1/current/blk_1719649238952092533
2013-10-31 16:15:56,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2623433961007257862_1277 file build/test/data/dfs/data/data2/current/blk_2623433961007257862 for deletion
2013-10-31 16:15:56,850 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2558601193971908172_1278 at file build/test/data/dfs/data/data1/current/blk_2558601193971908172
2013-10-31 16:15:56,850 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2623433961007257862_1277 at file build/test/data/dfs/data/data2/current/blk_2623433961007257862
2013-10-31 16:15:56,850 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8206799160724257515_1275 file build/test/data/dfs/data/data2/current/blk_8206799160724257515 for deletion
2013-10-31 16:15:56,851 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8206799160724257515_1275 at file build/test/data/dfs/data/data2/current/blk_8206799160724257515
2013-10-31 16:15:56,994 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_331774167 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:57,004 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25710 with signal TERM. Exit code 0
2013-10-31 16:15:57,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8601652280056973022_1281 file build/test/data/dfs/data/data7/current/blk_-8601652280056973022 for deletion
2013-10-31 16:15:57,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7985283914289950420_1279 file build/test/data/dfs/data/data7/current/blk_-7985283914289950420 for deletion
2013-10-31 16:15:57,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8601652280056973022_1281 at file build/test/data/dfs/data/data7/current/blk_-8601652280056973022
2013-10-31 16:15:57,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-661464544657018414_1289 file build/test/data/dfs/data/data7/current/blk_-661464544657018414 for deletion
2013-10-31 16:15:57,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7985283914289950420_1279 at file build/test/data/dfs/data/data7/current/blk_-7985283914289950420
2013-10-31 16:15:57,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1719649238952092533_1281 file build/test/data/dfs/data/data8/current/blk_1719649238952092533 for deletion
2013-10-31 16:15:57,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-661464544657018414_1289 at file build/test/data/dfs/data/data7/current/blk_-661464544657018414
2013-10-31 16:15:57,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2623433961007257862_1277 file build/test/data/dfs/data/data8/current/blk_2623433961007257862 for deletion
2013-10-31 16:15:57,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1719649238952092533_1281 at file build/test/data/dfs/data/data8/current/blk_1719649238952092533
2013-10-31 16:15:57,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8206799160724257515_1275 file build/test/data/dfs/data/data8/current/blk_8206799160724257515 for deletion
2013-10-31 16:15:57,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2623433961007257862_1277 at file build/test/data/dfs/data/data8/current/blk_2623433961007257862
2013-10-31 16:15:57,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8206799160724257515_1275 at file build/test/data/dfs/data/data8/current/blk_8206799160724257515
2013-10-31 16:15:57,176 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:57,176 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:57,176 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:57,177 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_331774167 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:15:57,303 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-750470584501963121_1282 blk_-8601652280056973022_1281 blk_1719649238952092533_1281 blk_2623433961007257862_1277 blk_-7985283914289950420_1279 blk_2558601193971908172_1278
2013-10-31 16:15:57,303 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-750470584501963121_1282 blk_-661464544657018414_1289 blk_8206799160724257515_1275 blk_2558601193971908172_1278
2013-10-31 16:15:57,447 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-750470584501963121_1282 file build/test/data/dfs/data/data4/current/blk_-750470584501963121 for deletion
2013-10-31 16:15:57,447 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-661464544657018414_1289 file build/test/data/dfs/data/data4/current/blk_-661464544657018414 for deletion
2013-10-31 16:15:57,447 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-750470584501963121_1282 at file build/test/data/dfs/data/data4/current/blk_-750470584501963121
2013-10-31 16:15:57,447 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2558601193971908172_1278 file build/test/data/dfs/data/data3/current/blk_2558601193971908172 for deletion
2013-10-31 16:15:57,448 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-661464544657018414_1289 at file build/test/data/dfs/data/data4/current/blk_-661464544657018414
2013-10-31 16:15:57,448 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8206799160724257515_1275 file build/test/data/dfs/data/data4/current/blk_8206799160724257515 for deletion
2013-10-31 16:15:57,448 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2558601193971908172_1278 at file build/test/data/dfs/data/data3/current/blk_2558601193971908172
2013-10-31 16:15:57,448 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8206799160724257515_1275 at file build/test/data/dfs/data/data4/current/blk_8206799160724257515
2013-10-31 16:15:57,864 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:57,864 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:57,864 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:57,864 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_-741228692 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:15:58,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8601652280056973022_1281 file build/test/data/dfs/data/data5/current/blk_-8601652280056973022 for deletion
2013-10-31 16:15:58,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7985283914289950420_1279 file build/test/data/dfs/data/data5/current/blk_-7985283914289950420 for deletion
2013-10-31 16:15:58,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8601652280056973022_1281 at file build/test/data/dfs/data/data5/current/blk_-8601652280056973022
2013-10-31 16:15:58,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-750470584501963121_1282 file build/test/data/dfs/data/data6/current/blk_-750470584501963121 for deletion
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7985283914289950420_1279 at file build/test/data/dfs/data/data5/current/blk_-7985283914289950420
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1719649238952092533_1281 file build/test/data/dfs/data/data6/current/blk_1719649238952092533 for deletion
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-750470584501963121_1282 at file build/test/data/dfs/data/data6/current/blk_-750470584501963121
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2558601193971908172_1278 file build/test/data/dfs/data/data6/current/blk_2558601193971908172 for deletion
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1719649238952092533_1281 at file build/test/data/dfs/data/data6/current/blk_1719649238952092533
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2623433961007257862_1277 file build/test/data/dfs/data/data5/current/blk_2623433961007257862 for deletion
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2558601193971908172_1278 at file build/test/data/dfs/data/data6/current/blk_2558601193971908172
2013-10-31 16:15:58,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2623433961007257862_1277 at file build/test/data/dfs/data/data5/current/blk_2623433961007257862
2013-10-31 16:15:58,505 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-1242438880 given task: attempt_20131031160444934_0026_m_000006_0
2013-10-31 16:15:59,048 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0025
2013-10-31 16:15:59,048 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000001_0 not found in cache
2013-10-31 16:15:59,048 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0025_m_000000_0 not found in cache
2013-10-31 16:15:59,049 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0025 for user-log deletion with retainTimeStamp:1383322559049
2013-10-31 16:15:59,050 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1612 Total time for transactions(ms): 36Number of transactions batched in Syncs: 172 Number of syncs: 1156 SyncTimes(ms): 49876 11492
2013-10-31 16:15:59,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:15:59,800 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0025_m_-2015129647 since job job_20131031160444934_0025 is dead
2013-10-31 16:15:59,810 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25489 with signal TERM. Exit code 0
2013-10-31 16:15:59,992 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:15:59,993 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:15:59,993 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:15:59,993 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0025_m_-2015129647 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:16:01,964 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000006_0 0.0% setup
2013-10-31 16:16:01,967 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000006_0 is done.
2013-10-31 16:16:01,967 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000006_0 was -1
2013-10-31 16:16:01,967 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:03,054 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000006_0' has completed task_20131031160444934_0026_m_000006 successfully.
2013-10-31 16:16:03,057 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000000_0' to tip task_20131031160444934_0026_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:03,058 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000000
2013-10-31 16:16:03,059 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000001_0' to tip task_20131031160444934_0026_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:03,059 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000001
2013-10-31 16:16:03,061 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:03,062 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:16:03,063 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000000_0 which needs 1 slots
2013-10-31 16:16:03,063 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000000_0 which needs 1 slots
2013-10-31 16:16:03,063 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000001_0 which needs 1 slots
2013-10-31 16:16:03,064 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0026_m_000001_0 which needs 1 slots
2013-10-31 16:16:03,104 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_-851400586
2013-10-31 16:16:03,105 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_-851400586 spawned.
2013-10-31 16:16:03,105 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0026/attempt_20131031160444934_0026_m_000001_0. Attempting to reuse: jvm_20131031160444934_0026_m_-1242438880
2013-10-31 16:16:03,106 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000000_0/taskjvm.sh
2013-10-31 16:16:03,327 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000002_0' to tip task_20131031160444934_0026_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:03,327 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000002
2013-10-31 16:16:03,328 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000003_0' to tip task_20131031160444934_0026_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:03,328 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000003
2013-10-31 16:16:03,330 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:16:03,331 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:16:03,331 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000002_0 which needs 1 slots
2013-10-31 16:16:03,331 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000002_0 which needs 1 slots
2013-10-31 16:16:03,331 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000003_0 which needs 1 slots
2013-10-31 16:16:03,332 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0026_m_000003_0 which needs 1 slots
2013-10-31 16:16:03,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken dst=null perm=null
2013-10-31 16:16:03,339 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48958, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3603487056913048693_1302, duration: 278296
2013-10-31 16:16:03,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml dst=null perm=null
2013-10-31 16:16:03,347 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48960, bytes: 28392, op: HDFS_READ, cliID: DFSClient_-379393667, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-754354625884155761_1299, duration: 373716
2013-10-31 16:16:03,368 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:03,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar dst=null perm=null
2013-10-31 16:16:03,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55964, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-379393667, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5219485888681558172_1296, duration: 1456671
2013-10-31 16:16:03,447 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_790658481
2013-10-31 16:16:03,448 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_790658481 spawned.
2013-10-31 16:16:03,449 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_1084653767
2013-10-31 16:16:03,449 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_1084653767 spawned.
2013-10-31 16:16:03,450 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000002_0/taskjvm.sh
2013-10-31 16:16:03,451 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000003_0/taskjvm.sh
2013-10-31 16:16:03,489 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0026_m_000004_0' to tip task_20131031160444934_0026_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:16:03,489 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0026_m_000004
2013-10-31 16:16:03,490 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:16:03,490 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000004_0 which needs 1 slots
2013-10-31 16:16:03,490 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000004_0 which needs 1 slots
2013-10-31 16:16:03,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026/jobToken dst=null perm=null
2013-10-31 16:16:03,494 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35929, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3603487056913048693_1302, duration: 134634
2013-10-31 16:16:03,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.xml dst=null perm=null
2013-10-31 16:16:03,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35862, bytes: 28392, op: HDFS_READ, cliID: DFSClient_1428518159, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-754354625884155761_1299, duration: 150213
2013-10-31 16:16:03,510 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:03,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.jar dst=null perm=null
2013-10-31 16:16:03,523 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35863, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1428518159, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5219485888681558172_1296, duration: 626811
2013-10-31 16:16:03,531 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-1242438880 given task: attempt_20131031160444934_0026_m_000001_0
2013-10-31 16:16:03,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=null
2013-10-31 16:16:03,630 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48967, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1998638381933410712_1297, duration: 158292
2013-10-31 16:16:03,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:16:03,670 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35866, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 110803
2013-10-31 16:16:03,902 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_m_1344813911
2013-10-31 16:16:03,903 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_m_1344813911 spawned.
2013-10-31 16:16:03,904 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_m_000004_0/taskjvm.sh
2013-10-31 16:16:03,950 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-851400586 given task: attempt_20131031160444934_0026_m_000000_0
2013-10-31 16:16:04,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=null
2013-10-31 16:16:04,449 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35938, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1998638381933410712_1297, duration: 170704
2013-10-31 16:16:04,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:16:04,679 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_790658481 given task: attempt_20131031160444934_0026_m_000002_0
2013-10-31 16:16:04,739 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 124677
2013-10-31 16:16:05,140 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_1084653767 given task: attempt_20131031160444934_0026_m_000003_0
2013-10-31 16:16:05,173 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_1344813911 given task: attempt_20131031160444934_0026_m_000004_0
2013-10-31 16:16:05,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=null
2013-10-31 16:16:05,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48977, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1998638381933410712_1297, duration: 167481
2013-10-31 16:16:05,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:16:05,248 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:48978, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 126175
2013-10-31 16:16:05,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=null
2013-10-31 16:16:05,640 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:55984, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1998638381933410712_1297, duration: 165384
2013-10-31 16:16:05,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026/job.split dst=null perm=null
2013-10-31 16:16:05,671 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35880, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1998638381933410712_1297, duration: 436914
2013-10-31 16:16:05,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:16:05,680 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35881, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 257299
2013-10-31 16:16:05,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:16:05,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35882, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0026_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 232018
2013-10-31 16:16:06,598 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:16:06,601 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000001_0 is done.
2013-10-31 16:16:06,601 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000001_0 was 6
2013-10-31 16:16:06,601 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:07,377 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:16:07,380 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000000_0 is done.
2013-10-31 16:16:07,380 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000000_0 was 6
2013-10-31 16:16:07,380 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:08,063 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0026_m_000006_0
2013-10-31 16:16:08,063 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0026_m_000006_0
2013-10-31 16:16:08,063 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0026_m_000006_0 not found in cache
2013-10-31 16:16:08,136 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:16:08,138 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000002_0 is done.
2013-10-31 16:16:08,139 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000002_0 was 6
2013-10-31 16:16:08,139 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:08,568 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:16:08,571 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000003_0 is done.
2013-10-31 16:16:08,571 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000003_0 was 6
2013-10-31 16:16:08,571 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:08,596 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:16:08,598 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000004_0 is done.
2013-10-31 16:16:08,598 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000004_0 was 6
2013-10-31 16:16:08,599 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:09,067 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000000_0' has completed task_20131031160444934_0026_m_000000 successfully.
2013-10-31 16:16:09,242 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000001_0' has completed task_20131031160444934_0026_m_000001 successfully.
2013-10-31 16:16:09,244 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0026_r_000000_0' to tip task_20131031160444934_0026_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:09,247 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:09,247 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_r_000000_0 which needs 1 slots
2013-10-31 16:16:09,247 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_r_000000_0 which needs 1 slots
2013-10-31 16:16:09,291 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0026_r_-1130629699
2013-10-31 16:16:09,292 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0026_r_-1130629699 spawned.
2013-10-31 16:16:09,293 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0026/attempt_20131031160444934_0026_r_000000_0/taskjvm.sh
2013-10-31 16:16:09,337 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000002_0' has completed task_20131031160444934_0026_m_000002 successfully.
2013-10-31 16:16:09,415 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000003_0' has completed task_20131031160444934_0026_m_000003 successfully.
2013-10-31 16:16:09,494 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000004_0' has completed task_20131031160444934_0026_m_000004 successfully.
2013-10-31 16:16:10,008 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 72 raw values into 1 aggregated values, total 31
2013-10-31 16:16:10,209 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_r_-1130629699 given task: attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:15,916 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:47678, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000000_0, duration: 10706306
2013-10-31 16:16:15,943 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:47678, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000001_0, duration: 11821829
2013-10-31 16:16:15,960 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:48486, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000002_0, duration: 12248640
2013-10-31 16:16:15,977 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:48486, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000003_0, duration: 13400352
2013-10-31 16:16:15,993 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:59612, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0026_m_000004_0, duration: 11869067
2013-10-31 16:16:16,709 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:16,750 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:16,811 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:17,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:17,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:17,022 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000. blk_-5924082644072865753_1303
2013-10-31 16:16:17,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5924082644072865753_1303 src: /127.0.0.1:35958 dest: /127.0.0.1:38271
2013-10-31 16:16:17,045 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5924082644072865753_1303 src: /127.0.0.1:48992 dest: /127.0.0.1:47311
2013-10-31 16:16:17,045 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5924082644072865753_1303 src: /127.0.0.1:35891 dest: /127.0.0.1:50942
2013-10-31 16:16:17,047 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35891, dest: /127.0.0.1:50942, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0026_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5924082644072865753_1303, duration: 892532
2013-10-31 16:16:17,047 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5924082644072865753_1303 terminating
2013-10-31 16:16:17,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48992, dest: /127.0.0.1:47311, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0026_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5924082644072865753_1303, duration: 1228164
2013-10-31 16:16:17,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5924082644072865753_1303 terminating
2013-10-31 16:16:17,050 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35958, dest: /127.0.0.1:38271, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0026_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5924082644072865753_1303, duration: 3525481
2013-10-31 16:16:17,050 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5924082644072865753_1303 size 70
2013-10-31 16:16:17,050 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5924082644072865753_1303 terminating
2013-10-31 16:16:17,052 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5924082644072865753_1303 size 70
2013-10-31 16:16:17,053 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:17,053 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:17,054 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5924082644072865753_1303 size 70
2013-10-31 16:16:17,103 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0026_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:17,103 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:16:18,256 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0026_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:16:18,257 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:19,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0 dst=null perm=null
2013-10-31 16:16:19,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:19,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:19,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary/_attempt_20131031160444934_0026_r_000000_0 dst=null perm=null
2013-10-31 16:16:19,760 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 16:16:19,762 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 16:16:19,763 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_r_000000_0 is done.
2013-10-31 16:16:19,763 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_r_000000_0 was -1
2013-10-31 16:16:19,763 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:21,261 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_r_000000_0' has completed task_20131031160444934_0026_r_000000 successfully.
2013-10-31 16:16:21,264 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0026_m_000005_0' to tip task_20131031160444934_0026_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:21,267 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0026_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:16:21,267 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0026_m_000005_0 which needs 1 slots
2013-10-31 16:16:21,267 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0026_m_000005_0 which needs 1 slots
2013-10-31 16:16:21,325 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0026/attempt_20131031160444934_0026_m_000005_0. Attempting to reuse: jvm_20131031160444934_0026_m_-1242438880
2013-10-31 16:16:22,146 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0026_m_-1242438880 given task: attempt_20131031160444934_0026_m_000005_0
2013-10-31 16:16:22,264 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000005_0 0.0%
2013-10-31 16:16:22,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_temporary dst=null perm=null
2013-10-31 16:16:22,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:22,375 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_SUCCESS from client DFSClient_attempt_20131031160444934_0026_m_000005_0
2013-10-31 16:16:22,376 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0026_m_000005_0
2013-10-31 16:16:22,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:22,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5219485888681558172 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,418 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,418 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,418 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1998638381933410712 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:22,418 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3074485234667118697 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,419 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3074485234667118697 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,419 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3074485234667118697 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,419 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-754354625884155761 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:22,419 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-754354625884155761 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:22,419 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-754354625884155761 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:22,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0026 dst=null perm=null
2013-10-31 16:16:24,308 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-1998638381933410712_1297 blk_-5219485888681558172_1296 blk_-754354625884155761_1299 blk_3074485234667118697_1298
2013-10-31 16:16:24,308 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-1998638381933410712_1297 blk_-5219485888681558172_1296 blk_-754354625884155761_1299 blk_3074485234667118697_1298
2013-10-31 16:16:25,069 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data5/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:25,069 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data5/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:25,070 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-754354625884155761_1299 file build/test/data/dfs/data/data5/current/blk_-754354625884155761 for deletion
2013-10-31 16:16:25,070 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data5/current/blk_-5219485888681558172
2013-10-31 16:16:25,070 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3074485234667118697_1298 file build/test/data/dfs/data/data6/current/blk_3074485234667118697 for deletion
2013-10-31 16:16:25,070 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data5/current/blk_-1998638381933410712
2013-10-31 16:16:25,070 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3074485234667118697_1298 at file build/test/data/dfs/data/data6/current/blk_3074485234667118697
2013-10-31 16:16:25,071 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-754354625884155761_1299 at file build/test/data/dfs/data/data5/current/blk_-754354625884155761
2013-10-31 16:16:25,239 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0026_m_000005_0 0.0% cleanup
2013-10-31 16:16:25,241 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0026_m_000005_0 is done.
2013-10-31 16:16:25,241 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0026_m_000005_0 was -1
2013-10-31 16:16:25,241 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:26,267 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:26,267 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0026_r_000000_0
2013-10-31 16:16:27,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data8/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:27,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data7/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:27,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-754354625884155761_1299 file build/test/data/dfs/data/data7/current/blk_-754354625884155761 for deletion
2013-10-31 16:16:27,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data7/current/blk_-1998638381933410712
2013-10-31 16:16:27,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3074485234667118697_1298 file build/test/data/dfs/data/data8/current/blk_3074485234667118697 for deletion
2013-10-31 16:16:27,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-754354625884155761_1299 at file build/test/data/dfs/data/data7/current/blk_-754354625884155761
2013-10-31 16:16:27,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data8/current/blk_-5219485888681558172
2013-10-31 16:16:27,069 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3074485234667118697_1298 at file build/test/data/dfs/data/data8/current/blk_3074485234667118697
2013-10-31 16:16:27,274 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0026_m_000005_0' has completed task_20131031160444934_0026_m_000005 successfully.
2013-10-31 16:16:27,275 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0026 has completed successfully.
2013-10-31 16:16:27,275 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0026,submitTime=1383236152569,launchTime=1383236152668,firstMapTaskLaunchTime=1383236163057,firstReduceTaskLaunchTime=1383236169244,firstJobSetupTaskLaunchTime=1383236154040,firstJobCleanupTaskLaunchTime=1383236181264,finishTime=1383236187275,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D198DEC2FB1E42BAA7C2368DEA5C9FEF/4D61CF86ECC94701B9ED8A67A271C801] lower*upper/(2/2)
2013-10-31 16:16:27,279 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701. blk_-6262429360302313689_1304
2013-10-31 16:16:27,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6262429360302313689_1304 src: /127.0.0.1:35894 dest: /127.0.0.1:50942
2013-10-31 16:16:27,286 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6262429360302313689_1304 src: /127.0.0.1:48997 dest: /127.0.0.1:47311
2013-10-31 16:16:27,287 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6262429360302313689_1304 src: /127.0.0.1:35965 dest: /127.0.0.1:38271
2013-10-31 16:16:27,297 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35965, dest: /127.0.0.1:38271, bytes: 29744, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6262429360302313689_1304, duration: 5787872
2013-10-31 16:16:27,298 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6262429360302313689_1304 terminating
2013-10-31 16:16:27,298 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48997, dest: /127.0.0.1:47311, bytes: 29744, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6262429360302313689_1304, duration: 5965430
2013-10-31 16:16:27,299 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6262429360302313689_1304 terminating
2013-10-31 16:16:27,299 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6262429360302313689_1304 size 29744
2013-10-31 16:16:27,299 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35894, dest: /127.0.0.1:50942, bytes: 29744, op: HDFS_WRITE, cliID: DFSClient_311566579, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6262429360302313689_1304, duration: 5044582
2013-10-31 16:16:27,299 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6262429360302313689_1304 size 29744
2013-10-31 16:16:27,300 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6262429360302313689_1304 terminating
2013-10-31 16:16:27,302 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6262429360302313689_1304 size 29744
2013-10-31 16:16:27,303 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701 from client DFSClient_311566579
2013-10-31 16:16:27,303 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/_logs/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701 is closed by DFSClient_311566579
2013-10-31 16:16:27,309 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-1998638381933410712_1297 blk_-5219485888681558172_1296 blk_-754354625884155761_1299 blk_3074485234667118697_1298
2013-10-31 16:16:27,309 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-1998638381933410712_1297 blk_-5219485888681558172_1296
2013-10-31 16:16:27,313 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0026_1383236152569_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2F4D61CF86ECC94701 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:27,314 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000000_0'
2013-10-31 16:16:27,314 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000001_0'
2013-10-31 16:16:27,314 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000005_0'
2013-10-31 16:16:27,316 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000006_0'
2013-10-31 16:16:27,316 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3603487056913048693 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:27,316 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_r_000000_0'
2013-10-31 16:16:27,316 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3603487056913048693 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:27,317 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3603487056913048693 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:27,319 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0026_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:27,320 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/2) ...atform/joinfilteredbranch
2013-10-31 16:16:27,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0026 dst=null perm=null
2013-10-31 16:16:27,327 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:16:27,327 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:16:27,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:27,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:16:27,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,353 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar. blk_6563616459556469136_1305
2013-10-31 16:16:27,354 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:56003 dest: /127.0.0.1:41648
2013-10-31 16:16:27,356 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:49001 dest: /127.0.0.1:47311
2013-10-31 16:16:27,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:35900 dest: /127.0.0.1:50942
2013-10-31 16:16:27,368 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35900, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6563616459556469136_1305, duration: 6669020
2013-10-31 16:16:27,368 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6563616459556469136_1305 terminating
2013-10-31 16:16:27,368 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49001, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6563616459556469136_1305, duration: 7494879
2013-10-31 16:16:27,369 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6563616459556469136_1305 terminating
2013-10-31 16:16:27,369 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56003, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6563616459556469136_1305, duration: 8311793
2013-10-31 16:16:27,370 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6563616459556469136_1305 terminating
2013-10-31 16:16:27,370 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:27,371 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar from client DFSClient_1457307213
2013-10-31 16:16:27,372 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar is closed by DFSClient_1457307213
2013-10-31 16:16:27,372 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:27,373 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:27,377 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar. New replication is 10
2013-10-31 16:16:27,437 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000002_0'
2013-10-31 16:16:27,437 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000003_0'
2013-10-31 16:16:27,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data3/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:27,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data4/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:27,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data3/current/blk_-5219485888681558172
2013-10-31 16:16:27,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data4/current/blk_-1998638381933410712
2013-10-31 16:16:27,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-754354625884155761_1299 file build/test/data/dfs/data/data4/current/blk_-754354625884155761 for deletion
2013-10-31 16:16:27,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3074485234667118697_1298 file build/test/data/dfs/data/data3/current/blk_3074485234667118697 for deletion
2013-10-31 16:16:27,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-754354625884155761_1299 at file build/test/data/dfs/data/data4/current/blk_-754354625884155761
2013-10-31 16:16:27,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3074485234667118697_1298 at file build/test/data/dfs/data/data3/current/blk_3074485234667118697
2013-10-31 16:16:27,514 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:27,514 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0026 being deleted.
2013-10-31 16:16:27,514 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0026_m_000004_0'
2013-10-31 16:16:27,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar dst=null perm=null
2013-10-31 16:16:27,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,879 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:16:27,883 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:16:27,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:16:27,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,899 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split. New replication is 10
2013-10-31 16:16:27,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=null
2013-10-31 16:16:27,906 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split. blk_-6529624484255616460_1306
2013-10-31 16:16:27,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:35901 dest: /127.0.0.1:50942
2013-10-31 16:16:27,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:56007 dest: /127.0.0.1:41648
2013-10-31 16:16:27,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:49005 dest: /127.0.0.1:47311
2013-10-31 16:16:27,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6529624484255616460_1306 src: /127.0.0.1:35973 dest: /127.0.0.1:38271
2013-10-31 16:16:27,916 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35973, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 101457
2013-10-31 16:16:27,917 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,917 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49005, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6529624484255616460_1306, duration: 934455
2013-10-31 16:16:27,918 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,918 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,918 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56007, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6529624484255616460_1306, duration: 1916986
2013-10-31 16:16:27,919 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,919 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35901, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6529624484255616460_1306, duration: 2929703
2013-10-31 16:16:27,920 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6529624484255616460_1306 terminating
2013-10-31 16:16:27,921 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,921 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split from client DFSClient_1457307213
2013-10-31 16:16:27,922 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split is closed by DFSClient_1457307213
2013-10-31 16:16:27,922 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,923 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6529624484255616460_1306 size 1732
2013-10-31 16:16:27,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,941 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo. blk_-2701757164713452030_1307
2013-10-31 16:16:27,942 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2701757164713452030_1307 src: /127.0.0.1:56010 dest: /127.0.0.1:41648
2013-10-31 16:16:27,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2701757164713452030_1307 src: /127.0.0.1:49008 dest: /127.0.0.1:47311
2013-10-31 16:16:27,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2701757164713452030_1307 src: /127.0.0.1:35976 dest: /127.0.0.1:38271
2013-10-31 16:16:27,948 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35976, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2701757164713452030_1307, duration: 69861
2013-10-31 16:16:27,948 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2701757164713452030_1307 terminating
2013-10-31 16:16:27,949 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49008, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2701757164713452030_1307, duration: 897630
2013-10-31 16:16:27,949 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2701757164713452030_1307 terminating
2013-10-31 16:16:27,950 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56010, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2701757164713452030_1307, duration: 1805797
2013-10-31 16:16:27,950 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2701757164713452030_1307 terminating
2013-10-31 16:16:27,951 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2701757164713452030_1307 size 183
2013-10-31 16:16:27,954 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:16:27,954 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:16:27,955 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2701757164713452030_1307 size 183
2013-10-31 16:16:27,955 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2701757164713452030_1307 size 183
2013-10-31 16:16:27,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:27,979 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml. blk_58242616522772820_1308
2013-10-31 16:16:27,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_58242616522772820_1308 src: /127.0.0.1:56013 dest: /127.0.0.1:41648
2013-10-31 16:16:27,982 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_58242616522772820_1308 src: /127.0.0.1:35909 dest: /127.0.0.1:50942
2013-10-31 16:16:27,983 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_58242616522772820_1308 src: /127.0.0.1:49012 dest: /127.0.0.1:47311
2013-10-31 16:16:27,986 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49012, dest: /127.0.0.1:47311, bytes: 28747, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_58242616522772820_1308, duration: 236453
2013-10-31 16:16:27,987 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_58242616522772820_1308 terminating
2013-10-31 16:16:27,987 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35909, dest: /127.0.0.1:50942, bytes: 28747, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_58242616522772820_1308, duration: 1111772
2013-10-31 16:16:27,988 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_58242616522772820_1308 terminating
2013-10-31 16:16:27,988 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_58242616522772820_1308 size 28747
2013-10-31 16:16:27,988 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56013, dest: /127.0.0.1:41648, bytes: 28747, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_58242616522772820_1308, duration: 1911285
2013-10-31 16:16:27,988 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_58242616522772820_1308 size 28747
2013-10-31 16:16:27,989 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_58242616522772820_1308 terminating
2013-10-31 16:16:27,990 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml from client DFSClient_1457307213
2013-10-31 16:16:27,991 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml is closed by DFSClient_1457307213
2013-10-31 16:16:27,992 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_58242616522772820_1308 size 28747
2013-10-31 16:16:28,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml dst=null perm=null
2013-10-31 16:16:28,009 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56017, bytes: 28975, op: HDFS_READ, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_58242616522772820_1308, duration: 381221
2013-10-31 16:16:28,024 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0027: nMaps=5 nReduces=0 max=-1
2013-10-31 16:16:28,024 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0027 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:16:28,025 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0027 RESULT=SUCCESS
2013-10-31 16:16:28,025 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0027
2013-10-31 16:16:28,025 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0027
2013-10-31 16:16:28,025 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0027
2013-10-31 16:16:28,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:28,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:28,460 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml. blk_-8398817715825442056_1310
2013-10-31 16:16:28,461 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8398817715825442056_1310 src: /127.0.0.1:56018 dest: /127.0.0.1:41648
2013-10-31 16:16:28,463 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8398817715825442056_1310 src: /127.0.0.1:35983 dest: /127.0.0.1:38271
2013-10-31 16:16:28,465 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8398817715825442056_1310 src: /127.0.0.1:35915 dest: /127.0.0.1:50942
2013-10-31 16:16:28,469 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35915, dest: /127.0.0.1:50942, bytes: 28812, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8398817715825442056_1310, duration: 591008
2013-10-31 16:16:28,469 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8398817715825442056_1310 terminating
2013-10-31 16:16:28,470 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35983, dest: /127.0.0.1:38271, bytes: 28812, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8398817715825442056_1310, duration: 1809347
2013-10-31 16:16:28,470 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8398817715825442056_1310 terminating
2013-10-31 16:16:28,471 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8398817715825442056_1310 size 28812
2013-10-31 16:16:28,471 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56018, dest: /127.0.0.1:41648, bytes: 28812, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8398817715825442056_1310, duration: 2427823
2013-10-31 16:16:28,471 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8398817715825442056_1310 terminating
2013-10-31 16:16:28,473 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8398817715825442056_1310 size 28812
2013-10-31 16:16:28,473 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml from client DFSClient_-355221738
2013-10-31 16:16:28,474 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_conf.xml is closed by DFSClient_-355221738
2013-10-31 16:16:28,474 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8398817715825442056_1310 size 28812
2013-10-31 16:16:28,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:28,488 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken. blk_-9043489202376737003_1311
2013-10-31 16:16:28,490 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9043489202376737003_1311 src: /127.0.0.1:35985 dest: /127.0.0.1:38271
2013-10-31 16:16:28,491 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9043489202376737003_1311 src: /127.0.0.1:56022 dest: /127.0.0.1:41648
2013-10-31 16:16:28,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9043489202376737003_1311 src: /127.0.0.1:35918 dest: /127.0.0.1:50942
2013-10-31 16:16:28,496 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35918, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-9043489202376737003_1311, duration: 62724
2013-10-31 16:16:28,496 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9043489202376737003_1311 terminating
2013-10-31 16:16:28,497 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56022, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9043489202376737003_1311, duration: 850967
2013-10-31 16:16:28,497 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9043489202376737003_1311 terminating
2013-10-31 16:16:28,497 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-9043489202376737003_1311 size 116
2013-10-31 16:16:28,498 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35985, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9043489202376737003_1311, duration: 1710889
2013-10-31 16:16:28,498 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9043489202376737003_1311 terminating
2013-10-31 16:16:28,501 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-9043489202376737003_1311 size 116
2013-10-31 16:16:28,502 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken from client DFSClient_1457307213
2013-10-31 16:16:28,502 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken is closed by DFSClient_1457307213
2013-10-31 16:16:28,503 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-9043489202376737003_1311 size 116
2013-10-31 16:16:28,510 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken
2013-10-31 16:16:28,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.splitmetainfo dst=null perm=null
2013-10-31 16:16:28,515 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56024, bytes: 187, op: HDFS_READ, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2701757164713452030_1307, duration: 322793
2013-10-31 16:16:28,516 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0027 = 19. Number of splits = 5
2013-10-31 16:16:28,516 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,516 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,517 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,518 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,519 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0027_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:28,520 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0027 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:16:28,520 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0027 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:16:29,858 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5219485888681558172_1296 file build/test/data/dfs/data/data2/current/blk_-5219485888681558172 for deletion
2013-10-31 16:16:29,858 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1998638381933410712_1297 file build/test/data/dfs/data/data1/current/blk_-1998638381933410712 for deletion
2013-10-31 16:16:29,859 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5219485888681558172_1296 at file build/test/data/dfs/data/data2/current/blk_-5219485888681558172
2013-10-31 16:16:29,859 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1998638381933410712_1297 at file build/test/data/dfs/data/data1/current/blk_-1998638381933410712
2013-10-31 16:16:30,310 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_6563616459556469136_1305 to datanode(s) 127.0.0.1:38271
2013-10-31 16:16:30,310 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-3603487056913048693_1302
2013-10-31 16:16:30,311 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-3603487056913048693_1302
2013-10-31 16:16:30,321 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0027_m_000006_0' to tip task_20131031160444934_0027_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:30,326 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:16:30,327 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000006_0 which needs 1 slots
2013-10-31 16:16:30,327 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000006_0 which needs 1 slots
2013-10-31 16:16:30,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken dst=null perm=null
2013-10-31 16:16:30,332 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:35989, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-9043489202376737003_1311, duration: 315779
2013-10-31 16:16:30,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml dst=null perm=null
2013-10-31 16:16:30,337 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35922, bytes: 28975, op: HDFS_READ, cliID: DFSClient_1341455733, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_58242616522772820_1308, duration: 382032
2013-10-31 16:16:30,356 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:30,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar dst=null perm=null
2013-10-31 16:16:30,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56028, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1341455733, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6563616459556469136_1305, duration: 622899
2013-10-31 16:16:30,435 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0026_m_-851400586
2013-10-31 16:16:30,440 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26261 with signal TERM. Exit code 0
2013-10-31 16:16:30,440 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1178212220
2013-10-31 16:16:30,440 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1178212220 spawned.
2013-10-31 16:16:30,442 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000006_0/taskjvm.sh
2013-10-31 16:16:30,465 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0026_m_-851400586
2013-10-31 16:16:31,097 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:31,097 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:31,097 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:31,097 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_-851400586 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:31,744 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1178212220 given task: attempt_20131031160444934_0027_m_000006_0
2013-10-31 16:16:32,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:32,317 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:32,317 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0026_m_000005_0 not found in cache
2013-10-31 16:16:32,318 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0026 for user-log deletion with retainTimeStamp:1383322592317
2013-10-31 16:16:32,318 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_r_-1130629699 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:32,324 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26552 with signal TERM. Exit code 0
2013-10-31 16:16:32,438 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:32,439 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0026 for user-log deletion with retainTimeStamp:1383322592438
2013-10-31 16:16:32,492 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:32,492 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:32,492 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:32,492 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_r_-1130629699 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:32,515 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0026
2013-10-31 16:16:32,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0026 for user-log deletion with retainTimeStamp:1383322592515
2013-10-31 16:16:32,721 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_790658481 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:32,733 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26344 with signal TERM. Exit code 0
2013-10-31 16:16:32,858 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3603487056913048693_1302 file build/test/data/dfs/data/data1/current/blk_-3603487056913048693 for deletion
2013-10-31 16:16:32,859 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3603487056913048693_1302 at file build/test/data/dfs/data/data1/current/blk_-3603487056913048693
2013-10-31 16:16:32,955 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:32,955 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:32,955 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:32,956 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_790658481 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:33,069 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_6563616459556469136_1305 to 127.0.0.1:38271
2013-10-31 16:16:33,070 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3603487056913048693_1302 file build/test/data/dfs/data/data8/current/blk_-3603487056913048693 for deletion
2013-10-31 16:16:33,070 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3603487056913048693_1302 at file build/test/data/dfs/data/data8/current/blk_-3603487056913048693
2013-10-31 16:16:33,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6563616459556469136_1305 src: /127.0.0.1:35996 dest: /127.0.0.1:38271
2013-10-31 16:16:33,071 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_6563616459556469136_1305 to /127.0.0.1:38271
2013-10-31 16:16:33,075 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6563616459556469136_1305 src: /127.0.0.1:35996 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:16:33,075 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6563616459556469136_1305 size 238055
2013-10-31 16:16:33,161 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_1344813911 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:33,162 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_1084653767 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:33,172 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26385 with signal TERM. Exit code 0
2013-10-31 16:16:33,172 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26384 with signal TERM. Exit code 0
2013-10-31 16:16:33,280 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0026_m_-1242438880 since job job_20131031160444934_0026 is dead
2013-10-31 16:16:33,285 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26168 with signal TERM. Exit code 0
2013-10-31 16:16:33,311 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-3603487056913048693_1302
2013-10-31 16:16:33,391 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:33,391 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:33,391 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:33,392 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:33,391 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:33,392 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:33,393 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_1084653767 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:33,393 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_1344813911 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:33,455 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:33,456 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:33,456 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:33,456 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0026_m_-1242438880 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:16:33,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3603487056913048693_1302 file build/test/data/dfs/data/data4/current/blk_-3603487056913048693 for deletion
2013-10-31 16:16:33,459 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3603487056913048693_1302 at file build/test/data/dfs/data/data4/current/blk_-3603487056913048693
2013-10-31 16:16:35,181 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000006_0 0.0% setup
2013-10-31 16:16:35,184 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000006_0 is done.
2013-10-31 16:16:35,185 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000006_0 was -1
2013-10-31 16:16:35,185 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:36,331 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000006_0' has completed task_20131031160444934_0027_m_000006 successfully.
2013-10-31 16:16:36,334 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000000_0' to tip task_20131031160444934_0027_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:36,335 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000000
2013-10-31 16:16:36,335 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000001_0' to tip task_20131031160444934_0027_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:36,336 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000001
2013-10-31 16:16:36,338 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:36,339 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:16:36,339 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000000_0 which needs 1 slots
2013-10-31 16:16:36,339 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000000_0 which needs 1 slots
2013-10-31 16:16:36,340 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000001_0 which needs 1 slots
2013-10-31 16:16:36,340 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0027_m_000001_0 which needs 1 slots
2013-10-31 16:16:36,370 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_404846204
2013-10-31 16:16:36,371 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_404846204 spawned.
2013-10-31 16:16:36,372 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0027/attempt_20131031160444934_0027_m_000001_0. Attempting to reuse: jvm_20131031160444934_0027_m_-1178212220
2013-10-31 16:16:36,372 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000000_0/taskjvm.sh
2013-10-31 16:16:36,444 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000002_0' to tip task_20131031160444934_0027_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:36,445 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000002
2013-10-31 16:16:36,445 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000003_0' to tip task_20131031160444934_0027_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:36,446 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000003
2013-10-31 16:16:36,447 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:16:36,448 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:16:36,448 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000002_0 which needs 1 slots
2013-10-31 16:16:36,448 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000002_0 which needs 1 slots
2013-10-31 16:16:36,449 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000003_0 which needs 1 slots
2013-10-31 16:16:36,449 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0027_m_000003_0 which needs 1 slots
2013-10-31 16:16:36,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken dst=null perm=null
2013-10-31 16:16:36,457 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56036, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9043489202376737003_1311, duration: 278884
2013-10-31 16:16:36,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml dst=null perm=null
2013-10-31 16:16:36,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49035, bytes: 28975, op: HDFS_READ, cliID: DFSClient_-1922558963, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_58242616522772820_1308, duration: 362642
2013-10-31 16:16:36,489 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:36,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar dst=null perm=null
2013-10-31 16:16:36,502 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56039, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1922558963, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6563616459556469136_1305, duration: 597177
2013-10-31 16:16:36,522 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0027_m_000004_0' to tip task_20131031160444934_0027_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:16:36,522 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0027_m_000004
2013-10-31 16:16:36,523 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:16:36,523 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000004_0 which needs 1 slots
2013-10-31 16:16:36,523 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000004_0 which needs 1 slots
2013-10-31 16:16:36,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027/jobToken dst=null perm=null
2013-10-31 16:16:36,526 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56040, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-9043489202376737003_1311, duration: 184806
2013-10-31 16:16:36,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.xml dst=null perm=null
2013-10-31 16:16:36,531 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35937, bytes: 28975, op: HDFS_READ, cliID: DFSClient_-951188114, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_58242616522772820_1308, duration: 154505
2013-10-31 16:16:36,544 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:36,554 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_623587581
2013-10-31 16:16:36,555 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_623587581 spawned.
2013-10-31 16:16:36,556 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1289007788
2013-10-31 16:16:36,556 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1289007788 spawned.
2013-10-31 16:16:36,557 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000002_0/taskjvm.sh
2013-10-31 16:16:36,557 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000003_0/taskjvm.sh
2013-10-31 16:16:36,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.jar dst=null perm=null
2013-10-31 16:16:36,560 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36007, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-951188114, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6563616459556469136_1305, duration: 594154
2013-10-31 16:16:36,741 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1194820009
2013-10-31 16:16:36,741 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1194820009 spawned.
2013-10-31 16:16:36,742 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000004_0/taskjvm.sh
2013-10-31 16:16:36,748 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1178212220 given task: attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:36,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=null
2013-10-31 16:16:36,847 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49042, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6529624484255616460_1306, duration: 165641
2013-10-31 16:16:36,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:16:36,888 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36010, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 125003
2013-10-31 16:16:36,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:37,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:37,204 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_404846204 given task: attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:37,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853 dst=null perm=null
2013-10-31 16:16:37,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:37,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:37,276 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49045, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5924082644072865753_1303, duration: 160719
2013-10-31 16:16:37,296 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001. blk_2697455260120737558_1312
2013-10-31 16:16:37,318 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2697455260120737558_1312 src: /127.0.0.1:36013 dest: /127.0.0.1:38271
2013-10-31 16:16:37,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2697455260120737558_1312 src: /127.0.0.1:56050 dest: /127.0.0.1:41648
2013-10-31 16:16:37,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2697455260120737558_1312 src: /127.0.0.1:35946 dest: /127.0.0.1:50942
2013-10-31 16:16:37,323 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35946, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2697455260120737558_1312, duration: 1879546
2013-10-31 16:16:37,324 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2697455260120737558_1312 terminating
2013-10-31 16:16:37,324 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56050, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2697455260120737558_1312, duration: 2112264
2013-10-31 16:16:37,324 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2697455260120737558_1312 terminating
2013-10-31 16:16:37,324 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36013, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2697455260120737558_1312, duration: 2479135
2013-10-31 16:16:37,324 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2697455260120737558_1312 terminating
2013-10-31 16:16:37,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2697455260120737558_1312 size 14
2013-10-31 16:16:37,326 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:37,326 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:37,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2697455260120737558_1312 size 14
2013-10-31 16:16:37,328 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2697455260120737558_1312 size 14
2013-10-31 16:16:37,366 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:37,367 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000001_0 0.0%
2013-10-31 16:16:37,678 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_623587581 given task: attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:37,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=null
2013-10-31 16:16:37,749 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36020, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 169770
2013-10-31 16:16:37,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:16:37,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:37,805 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1289007788 given task: attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:37,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:37,818 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1194820009 given task: attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:38,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853 dst=null perm=null
2013-10-31 16:16:38,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,047 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35952, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5924082644072865753_1303, duration: 209402
2013-10-31 16:16:38,063 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49055, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 128529
2013-10-31 16:16:38,069 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000. blk_4396387988779245889_1313
2013-10-31 16:16:38,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4396387988779245889_1313 src: /127.0.0.1:49056 dest: /127.0.0.1:47311
2013-10-31 16:16:38,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4396387988779245889_1313 src: /127.0.0.1:56061 dest: /127.0.0.1:41648
2013-10-31 16:16:38,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4396387988779245889_1313 src: /127.0.0.1:35957 dest: /127.0.0.1:50942
2013-10-31 16:16:38,103 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35957, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4396387988779245889_1313, duration: 1487129
2013-10-31 16:16:38,104 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4396387988779245889_1313 terminating
2013-10-31 16:16:38,104 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56061, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4396387988779245889_1313, duration: 1611947
2013-10-31 16:16:38,104 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4396387988779245889_1313 terminating
2013-10-31 16:16:38,104 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49056, dest: /127.0.0.1:47311, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4396387988779245889_1313, duration: 1979997
2013-10-31 16:16:38,104 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4396387988779245889_1313 terminating
2013-10-31 16:16:38,105 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4396387988779245889_1313 size 14
2013-10-31 16:16:38,105 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:38,105 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:38,105 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4396387988779245889_1313 size 14
2013-10-31 16:16:38,106 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4396387988779245889_1313 size 14
2013-10-31 16:16:38,164 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:38,165 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000000_0 0.0%
2013-10-31 16:16:38,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=null
2013-10-31 16:16:38,188 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56063, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6529624484255616460_1306, duration: 166673
2013-10-31 16:16:38,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:16:38,231 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36029, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 126710
2013-10-31 16:16:38,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:38,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=null
2013-10-31 16:16:38,301 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36031, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 160875
2013-10-31 16:16:38,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027/job.split dst=null perm=null
2013-10-31 16:16:38,329 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36032, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6529624484255616460_1306, duration: 161203
2013-10-31 16:16:38,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:16:38,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:16:38,647 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49066, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 266324
2013-10-31 16:16:38,647 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36034, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 269742
2013-10-31 16:16:38,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:38,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:38,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:38,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:38,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:38,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853 dst=null perm=null
2013-10-31 16:16:38,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853 dst=null perm=null
2013-10-31 16:16:38,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853 dst=null perm=null
2013-10-31 16:16:38,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,957 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49068, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5924082644072865753_1303, duration: 143505
2013-10-31 16:16:38,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853/part-00000 dst=null perm=null
2013-10-31 16:16:38,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35967, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5924082644072865753_1303, duration: 129290
2013-10-31 16:16:38,961 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36037, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5924082644072865753_1303, duration: 125114
2013-10-31 16:16:38,977 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003. blk_8510502824651321761_1316
2013-10-31 16:16:38,979 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004. blk_-5537475891041042573_1316
2013-10-31 16:16:38,981 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002. blk_7458281921813337393_1316
2013-10-31 16:16:39,000 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8510502824651321761_1316 src: /127.0.0.1:49071 dest: /127.0.0.1:47311
2013-10-31 16:16:39,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8510502824651321761_1316 src: /127.0.0.1:35972 dest: /127.0.0.1:50942
2013-10-31 16:16:39,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5537475891041042573_1316 src: /127.0.0.1:35970 dest: /127.0.0.1:50942
2013-10-31 16:16:39,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8510502824651321761_1316 src: /127.0.0.1:36042 dest: /127.0.0.1:38271
2013-10-31 16:16:39,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5537475891041042573_1316 src: /127.0.0.1:56079 dest: /127.0.0.1:41648
2013-10-31 16:16:39,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5537475891041042573_1316 src: /127.0.0.1:36044 dest: /127.0.0.1:38271
2013-10-31 16:16:39,004 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36042, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8510502824651321761_1316, duration: 1023160
2013-10-31 16:16:39,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7458281921813337393_1316 src: /127.0.0.1:36040 dest: /127.0.0.1:38271
2013-10-31 16:16:39,007 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8510502824651321761_1316 size 14
2013-10-31 16:16:39,007 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8510502824651321761_1316 terminating
2013-10-31 16:16:39,007 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35972, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8510502824651321761_1316, duration: 4594011
2013-10-31 16:16:39,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36044, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5537475891041042573_1316, duration: 213631
2013-10-31 16:16:39,008 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5537475891041042573_1316 size 14
2013-10-31 16:16:39,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8510502824651321761_1316 terminating
2013-10-31 16:16:39,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49071, dest: /127.0.0.1:47311, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8510502824651321761_1316, duration: 5678084
2013-10-31 16:16:39,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5537475891041042573_1316 terminating
2013-10-31 16:16:39,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7458281921813337393_1316 src: /127.0.0.1:35976 dest: /127.0.0.1:50942
2013-10-31 16:16:39,009 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8510502824651321761_1316 terminating
2013-10-31 16:16:39,009 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56079, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5537475891041042573_1316, duration: 2133647
2013-10-31 16:16:39,011 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:39,011 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5537475891041042573_1316 terminating
2013-10-31 16:16:39,011 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:39,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7458281921813337393_1316 src: /127.0.0.1:56082 dest: /127.0.0.1:41648
2013-10-31 16:16:39,011 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35970, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5537475891041042573_1316, duration: 4196209
2013-10-31 16:16:39,011 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5537475891041042573_1316 size 14
2013-10-31 16:16:39,012 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5537475891041042573_1316 terminating
2013-10-31 16:16:39,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8510502824651321761_1316 size 14
2013-10-31 16:16:39,015 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:39,015 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:39,015 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56082, dest: /127.0.0.1:41648, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7458281921813337393_1316, duration: 1777793
2013-10-31 16:16:39,015 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8510502824651321761_1316 size 14
2013-10-31 16:16:39,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7458281921813337393_1316 terminating
2013-10-31 16:16:39,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5537475891041042573_1316 size 14
2013-10-31 16:16:39,016 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35976, dest: /127.0.0.1:50942, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7458281921813337393_1316, duration: 978472
2013-10-31 16:16:39,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7458281921813337393_1316 terminating
2013-10-31 16:16:39,016 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36040, dest: /127.0.0.1:38271, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0027_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7458281921813337393_1316, duration: 1070706
2013-10-31 16:16:39,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7458281921813337393_1316 size 14
2013-10-31 16:16:39,017 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7458281921813337393_1316 terminating
2013-10-31 16:16:39,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7458281921813337393_1316 size 14
2013-10-31 16:16:39,017 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:39,018 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:39,020 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7458281921813337393_1316 size 14
2013-10-31 16:16:39,067 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:39,067 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000002_0 0.0%
2013-10-31 16:16:39,071 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:39,071 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000003_0 0.0%
2013-10-31 16:16:39,077 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0027_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:16:39,077 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000004_0 0.0%
2013-10-31 16:16:39,343 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000000_0
2013-10-31 16:16:39,343 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000001_0
2013-10-31 16:16:39,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0 dst=null perm=null
2013-10-31 16:16:39,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:39,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:39,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000001_0 dst=null perm=null
2013-10-31 16:16:39,453 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000002_0
2013-10-31 16:16:39,453 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000003_0
2013-10-31 16:16:39,527 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0027_m_000004_0
2013-10-31 16:16:39,812 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:16:39,814 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000001_0 is done.
2013-10-31 16:16:39,814 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000001_0 was -1
2013-10-31 16:16:39,814 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:39,848 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:16:39,863 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,868 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,874 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,879 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,890 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:16:39,890 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:16:40,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0 dst=null perm=null
2013-10-31 16:16:40,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0 dst=null perm=null
2013-10-31 16:16:40,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0 dst=null perm=null
2013-10-31 16:16:40,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000002_0 dst=null perm=null
2013-10-31 16:16:40,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0 dst=null perm=null
2013-10-31 16:16:40,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:40,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000003_0 dst=null perm=null
2013-10-31 16:16:40,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000004_0 dst=null perm=null
2013-10-31 16:16:40,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:40,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary/_attempt_20131031160444934_0027_m_000000_0 dst=null perm=null
2013-10-31 16:16:40,643 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:16:40,644 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000000_0 is done.
2013-10-31 16:16:40,645 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000000_0 was -1
2013-10-31 16:16:40,645 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:41,113 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:16:41,114 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000002_0 is done.
2013-10-31 16:16:41,115 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000002_0 was -1
2013-10-31 16:16:41,115 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:16:41,227 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:16:41,229 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000003_0 is done.
2013-10-31 16:16:41,229 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000003_0 was -1
2013-10-31 16:16:41,229 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:41,257 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:16:41,258 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000004_0 is done.
2013-10-31 16:16:41,258 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000004_0 was -1
2013-10-31 16:16:41,258 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:41,339 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0027_m_000006_0
2013-10-31 16:16:41,339 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0027_m_000006_0
2013-10-31 16:16:41,339 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000006_0 not found in cache
2013-10-31 16:16:42,347 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000000_0' has completed task_20131031160444934_0027_m_000000 successfully.
2013-10-31 16:16:42,349 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000001_0' has completed task_20131031160444934_0027_m_000001 successfully.
2013-10-31 16:16:42,457 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000002_0' has completed task_20131031160444934_0027_m_000002 successfully.
2013-10-31 16:16:42,459 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000003_0' has completed task_20131031160444934_0027_m_000003 successfully.
2013-10-31 16:16:42,531 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000004_0' has completed task_20131031160444934_0027_m_000004 successfully.
2013-10-31 16:16:42,533 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0027_m_000005_0' to tip task_20131031160444934_0027_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:16:42,536 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0027_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:16:42,536 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0027_m_000005_0 which needs 1 slots
2013-10-31 16:16:42,537 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0027_m_000005_0 which needs 1 slots
2013-10-31 16:16:42,569 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0027_m_-1344958877
2013-10-31 16:16:42,570 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0027_m_-1344958877 spawned.
2013-10-31 16:16:42,571 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0027/attempt_20131031160444934_0027_m_000005_0/taskjvm.sh
2013-10-31 16:16:43,428 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0027_m_-1344958877 given task: attempt_20131031160444934_0027_m_000005_0
2013-10-31 16:16:43,931 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000005_0 0.0%
2013-10-31 16:16:43,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary dst=null perm=null
2013-10-31 16:16:43,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:43,953 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS from client DFSClient_attempt_20131031160444934_0027_m_000005_0
2013-10-31 16:16:43,954 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0027_m_000005_0
2013-10-31 16:16:43,959 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,959 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,959 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6563616459556469136 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6529624484255616460 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2701757164713452030 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2701757164713452030 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2701757164713452030 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_58242616522772820 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_58242616522772820 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:43,960 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_58242616522772820 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:43,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0027 dst=null perm=null
2013-10-31 16:16:45,313 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_58242616522772820_1308 blk_6563616459556469136_1305 blk_-6529624484255616460_1306
2013-10-31 16:16:45,314 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_58242616522772820_1308 blk_6563616459556469136_1305 blk_-6529624484255616460_1306 blk_-2701757164713452030_1307
2013-10-31 16:16:45,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data4/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:45,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2701757164713452030_1307 file build/test/data/dfs/data/data3/current/blk_-2701757164713452030 for deletion
2013-10-31 16:16:45,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data4/current/blk_-6529624484255616460
2013-10-31 16:16:45,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_58242616522772820_1308 file build/test/data/dfs/data/data4/current/blk_58242616522772820 for deletion
2013-10-31 16:16:45,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2701757164713452030_1307 at file build/test/data/dfs/data/data3/current/blk_-2701757164713452030
2013-10-31 16:16:45,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_58242616522772820_1308 at file build/test/data/dfs/data/data4/current/blk_58242616522772820
2013-10-31 16:16:45,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data3/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:45,465 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data3/current/blk_6563616459556469136
2013-10-31 16:16:46,866 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0027_m_000005_0 0.0% cleanup
2013-10-31 16:16:46,867 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0027_m_000005_0 is done.
2013-10-31 16:16:46,868 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0027_m_000005_0 was -1
2013-10-31 16:16:46,868 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:48,074 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data8/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:48,074 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_58242616522772820_1308 file build/test/data/dfs/data/data7/current/blk_58242616522772820 for deletion
2013-10-31 16:16:48,074 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data8/current/blk_-6529624484255616460
2013-10-31 16:16:48,074 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data7/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:48,075 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_58242616522772820_1308 at file build/test/data/dfs/data/data7/current/blk_58242616522772820
2013-10-31 16:16:48,075 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data7/current/blk_6563616459556469136
2013-10-31 16:16:48,314 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_58242616522772820_1308 blk_6563616459556469136_1305 blk_-6529624484255616460_1306 blk_-2701757164713452030_1307
2013-10-31 16:16:48,314 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_6563616459556469136_1305 blk_-6529624484255616460_1306 blk_-2701757164713452030_1307
2013-10-31 16:16:48,544 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0027_m_000005_0' has completed task_20131031160444934_0027_m_000005 successfully.
2013-10-31 16:16:48,545 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0027 has completed successfully.
2013-10-31 16:16:48,546 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0027,submitTime=1383236188000,launchTime=1383236188520,firstMapTaskLaunchTime=1383236196334,firstJobSetupTaskLaunchTime=1383236190321,firstJobCleanupTaskLaunchTime=1383236202533,finishTime=1383236208545,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D198DEC2FB1E42BAA7C2368DEA5C9FEF/D1F0EC65F53C4984AE7BD7AC858FA9B2] lower*upper/(1/2) ...atform/joinfilteredbranch
2013-10-31 16:16:48,551 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984. blk_7293811695906113261_1317
2013-10-31 16:16:48,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7293811695906113261_1317 src: /127.0.0.1:35981 dest: /127.0.0.1:50942
2013-10-31 16:16:48,556 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7293811695906113261_1317 src: /127.0.0.1:49084 dest: /127.0.0.1:47311
2013-10-31 16:16:48,559 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7293811695906113261_1317 src: /127.0.0.1:36052 dest: /127.0.0.1:38271
2013-10-31 16:16:48,562 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36052, dest: /127.0.0.1:38271, bytes: 26353, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7293811695906113261_1317, duration: 194518
2013-10-31 16:16:48,562 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7293811695906113261_1317 terminating
2013-10-31 16:16:48,563 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49084, dest: /127.0.0.1:47311, bytes: 26353, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7293811695906113261_1317, duration: 1043784
2013-10-31 16:16:48,563 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7293811695906113261_1317 terminating
2013-10-31 16:16:48,563 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:35981, dest: /127.0.0.1:50942, bytes: 26353, op: HDFS_WRITE, cliID: DFSClient_-355221738, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7293811695906113261_1317, duration: 1969897
2013-10-31 16:16:48,564 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7293811695906113261_1317 terminating
2013-10-31 16:16:48,568 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7293811695906113261_1317 size 26353
2013-10-31 16:16:48,568 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984 from client DFSClient_-355221738
2013-10-31 16:16:48,569 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_logs/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984 is closed by DFSClient_-355221738
2013-10-31 16:16:48,569 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7293811695906113261_1317 size 26353
2013-10-31 16:16:48,569 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7293811695906113261_1317 size 26353
2013-10-31 16:16:48,576 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0027_1383236188000_hadoop_%5BD198DEC2FB1E42BAA7C2368DEA5C9FEF%2FD1F0EC65F53C4984 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:48,577 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000004_0'
2013-10-31 16:16:48,577 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000005_0'
2013-10-31 16:16:48,579 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9043489202376737003 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:48,579 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9043489202376737003 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,579 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9043489202376737003 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:48,582 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0027_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:16:48,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0027 dst=null perm=null
2013-10-31 16:16:48,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6262429360302313689 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:48,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6262429360302313689 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6262429360302313689 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:48,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7019503529854675644 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,586 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7019503529854675644 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:48,586 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7019503529854675644 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:16:48,586 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5924082644072865753 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:16:48,586 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5924082644072865753 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:16:48,587 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5924082644072865753 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:16:48,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/587044626_upper_98CB6114A875401DA34EE723621C6853 dst=null perm=null
2013-10-31 16:16:48,594 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/_temporary
2013-10-31 16:16:48,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2013-10-31 16:16:48,614 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:16:48,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2013-10-31 16:16:48,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2013-10-31 16:16:48,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2013-10-31 16:16:48,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2013-10-31 16:16:48,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2013-10-31 16:16:48,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2013-10-31 16:16:48,624 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49087, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4396387988779245889_1313, duration: 273422
2013-10-31 16:16:48,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2013-10-31 16:16:48,627 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36055, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2697455260120737558_1312, duration: 255250
2013-10-31 16:16:48,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2013-10-31 16:16:48,630 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56092, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7458281921813337393_1316, duration: 251528
2013-10-31 16:16:48,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2013-10-31 16:16:48,633 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49090, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8510502824651321761_1316, duration: 253009
2013-10-31 16:16:48,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2013-10-31 16:16:48,636 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35989, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5537475891041042573_1316, duration: 260346
2013-10-31 16:16:48,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2013-10-31 16:16:48,654 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:16:48,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2013-10-31 16:16:48,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2013-10-31 16:16:48,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2013-10-31 16:16:48,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2013-10-31 16:16:48,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2013-10-31 16:16:48,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2013-10-31 16:16:48,663 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49092, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4396387988779245889_1313, duration: 261196
2013-10-31 16:16:48,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2013-10-31 16:16:48,666 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56096, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2697455260120737558_1312, duration: 255043
2013-10-31 16:16:48,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2013-10-31 16:16:48,669 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35992, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7458281921813337393_1316, duration: 249213
2013-10-31 16:16:48,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2013-10-31 16:16:48,672 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35993, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8510502824651321761_1316, duration: 249344
2013-10-31 16:16:48,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2013-10-31 16:16:48,675 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36063, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5537475891041042573_1316, duration: 253333
2013-10-31 16:16:48,676 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinfilteredbranch
2013-10-31 16:16:48,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2013-10-31 16:16:48,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2013-10-31 16:16:48,684 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35995, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4396387988779245889_1313, duration: 255622
2013-10-31 16:16:48,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2013-10-31 16:16:48,688 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56101, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2697455260120737558_1312, duration: 252093
2013-10-31 16:16:48,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2013-10-31 16:16:48,692 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56102, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7458281921813337393_1316, duration: 294319
2013-10-31 16:16:48,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2013-10-31 16:16:48,697 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:35998, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8510502824651321761_1316, duration: 320017
2013-10-31 16:16:48,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2013-10-31 16:16:48,701 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36068, bytes: 18, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5537475891041042573_1316, duration: 256109
2013-10-31 16:16:48,722 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:16:48,723 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:16:48,745 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] starting
2013-10-31 16:16:48,746 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:16:48,746 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:16:48,746 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:16:48,747 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin"]
2013-10-31 16:16:48,747 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] parallel execution is enabled: true
2013-10-31 16:16:48,747 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] starting jobs: 3
2013-10-31 16:16:48,747 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper1*upper2] allocating threads: 3
2013-10-31 16:16:48,748 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (3/3)
2013-10-31 16:16:48,752 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:16:48,753 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:16:48,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:48,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:16:48,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,775 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar. blk_-8815791525567125083_1318
2013-10-31 16:16:48,776 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:49102 dest: /127.0.0.1:47311
2013-10-31 16:16:48,778 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:36001 dest: /127.0.0.1:50942
2013-10-31 16:16:48,780 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:56107 dest: /127.0.0.1:41648
2013-10-31 16:16:48,787 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56107, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8815791525567125083_1318, duration: 3954969
2013-10-31 16:16:48,787 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8815791525567125083_1318 terminating
2013-10-31 16:16:48,788 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36001, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8815791525567125083_1318, duration: 5135924
2013-10-31 16:16:48,788 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8815791525567125083_1318 terminating
2013-10-31 16:16:48,789 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49102, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8815791525567125083_1318, duration: 5693865
2013-10-31 16:16:48,789 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:48,789 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8815791525567125083_1318 terminating
2013-10-31 16:16:48,790 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:48,791 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:48,791 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar from client DFSClient_1457307213
2013-10-31 16:16:48,792 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar is closed by DFSClient_1457307213
2013-10-31 16:16:48,798 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar. New replication is 10
2013-10-31 16:16:48,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar dst=null perm=null
2013-10-31 16:16:48,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,811 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:16:48,815 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:16:48,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:16:48,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:48,830 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split. New replication is 10
2013-10-31 16:16:48,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=null
2013-10-31 16:16:48,838 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split. blk_-8399440944438708311_1319
2013-10-31 16:16:48,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:36072 dest: /127.0.0.1:38271
2013-10-31 16:16:48,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:56109 dest: /127.0.0.1:41648
2013-10-31 16:16:48,842 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:49107 dest: /127.0.0.1:47311
2013-10-31 16:16:48,844 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8399440944438708311_1319 src: /127.0.0.1:36006 dest: /127.0.0.1:50942
2013-10-31 16:16:48,847 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36006, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8399440944438708311_1319, duration: 119986
2013-10-31 16:16:48,848 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,848 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49107, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8399440944438708311_1319, duration: 961589
2013-10-31 16:16:48,849 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,849 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56109, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8399440944438708311_1319, duration: 1830387
2013-10-31 16:16:48,849 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,850 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36072, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8399440944438708311_1319, duration: 2677710
2013-10-31 16:16:48,850 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:48,850 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-8399440944438708311_1319 terminating
2013-10-31 16:16:48,852 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:48,852 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split from client DFSClient_1457307213
2013-10-31 16:16:48,853 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split is closed by DFSClient_1457307213
2013-10-31 16:16:48,853 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:48,854 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8399440944438708311_1319 size 1732
2013-10-31 16:16:49,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data5/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:49,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2701757164713452030_1307 file build/test/data/dfs/data/data6/current/blk_-2701757164713452030 for deletion
2013-10-31 16:16:49,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data5/current/blk_-6529624484255616460
2013-10-31 16:16:49,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_58242616522772820_1308 file build/test/data/dfs/data/data5/current/blk_58242616522772820 for deletion
2013-10-31 16:16:49,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2701757164713452030_1307 at file build/test/data/dfs/data/data6/current/blk_-2701757164713452030
2013-10-31 16:16:49,080 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_58242616522772820_1308 at file build/test/data/dfs/data/data5/current/blk_58242616522772820
2013-10-31 16:16:49,080 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data6/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:49,081 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data6/current/blk_6563616459556469136
2013-10-31 16:16:49,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,750 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo. blk_-7961768246826946218_1320
2013-10-31 16:16:49,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7961768246826946218_1320 src: /127.0.0.1:56112 dest: /127.0.0.1:41648
2013-10-31 16:16:49,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7961768246826946218_1320 src: /127.0.0.1:36008 dest: /127.0.0.1:50942
2013-10-31 16:16:49,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7961768246826946218_1320 src: /127.0.0.1:36078 dest: /127.0.0.1:38271
2013-10-31 16:16:49,758 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36078, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7961768246826946218_1320, duration: 72137
2013-10-31 16:16:49,758 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7961768246826946218_1320 terminating
2013-10-31 16:16:49,759 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36008, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7961768246826946218_1320, duration: 841404
2013-10-31 16:16:49,759 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7961768246826946218_1320 size 183
2013-10-31 16:16:49,759 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7961768246826946218_1320 terminating
2013-10-31 16:16:49,760 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56112, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7961768246826946218_1320, duration: 2111895
2013-10-31 16:16:49,761 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7961768246826946218_1320 terminating
2013-10-31 16:16:49,764 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7961768246826946218_1320 size 183
2013-10-31 16:16:49,764 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:16:49,764 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:16:49,765 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7961768246826946218_1320 size 183
2013-10-31 16:16:49,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,795 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml. blk_1002969834028224173_1321
2013-10-31 16:16:49,796 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1002969834028224173_1321 src: /127.0.0.1:36079 dest: /127.0.0.1:38271
2013-10-31 16:16:49,798 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1002969834028224173_1321 src: /127.0.0.1:36011 dest: /127.0.0.1:50942
2013-10-31 16:16:49,799 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1002969834028224173_1321 src: /127.0.0.1:49114 dest: /127.0.0.1:47311
2013-10-31 16:16:49,802 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49114, dest: /127.0.0.1:47311, bytes: 27428, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1002969834028224173_1321, duration: 281671
2013-10-31 16:16:49,803 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1002969834028224173_1321 terminating
2013-10-31 16:16:49,803 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36011, dest: /127.0.0.1:50942, bytes: 27428, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1002969834028224173_1321, duration: 1224445
2013-10-31 16:16:49,804 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1002969834028224173_1321 terminating
2013-10-31 16:16:49,804 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1002969834028224173_1321 size 27428
2013-10-31 16:16:49,804 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36079, dest: /127.0.0.1:38271, bytes: 27428, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 2104855
2013-10-31 16:16:49,805 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1002969834028224173_1321 terminating
2013-10-31 16:16:49,807 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml from client DFSClient_1457307213
2013-10-31 16:16:49,808 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml is closed by DFSClient_1457307213
2013-10-31 16:16:49,808 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1002969834028224173_1321 size 27428
2013-10-31 16:16:49,809 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1002969834028224173_1321 size 27428
2013-10-31 16:16:49,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml dst=null perm=null
2013-10-31 16:16:49,825 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36083, bytes: 27644, op: HDFS_READ, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 397888
2013-10-31 16:16:49,843 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0028: nMaps=5 nReduces=0 max=-1
2013-10-31 16:16:49,843 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0028 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:16:49,843 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0028 RESULT=SUCCESS
2013-10-31 16:16:49,843 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0028
2013-10-31 16:16:49,843 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0028
2013-10-31 16:16:49,844 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0028
2013-10-31 16:16:49,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,874 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml. blk_5935025676836584846_1323
2013-10-31 16:16:49,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5935025676836584846_1323 src: /127.0.0.1:36015 dest: /127.0.0.1:50942
2013-10-31 16:16:49,877 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5935025676836584846_1323 src: /127.0.0.1:56121 dest: /127.0.0.1:41648
2013-10-31 16:16:49,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5935025676836584846_1323 src: /127.0.0.1:49119 dest: /127.0.0.1:47311
2013-10-31 16:16:49,883 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49119, dest: /127.0.0.1:47311, bytes: 27493, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5935025676836584846_1323, duration: 1038512
2013-10-31 16:16:49,883 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5935025676836584846_1323 terminating
2013-10-31 16:16:49,884 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56121, dest: /127.0.0.1:41648, bytes: 27493, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5935025676836584846_1323, duration: 1523641
2013-10-31 16:16:49,884 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5935025676836584846_1323 terminating
2013-10-31 16:16:49,884 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5935025676836584846_1323 size 27493
2013-10-31 16:16:49,885 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36015, dest: /127.0.0.1:50942, bytes: 27493, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5935025676836584846_1323, duration: 2752793
2013-10-31 16:16:49,885 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5935025676836584846_1323 terminating
2013-10-31 16:16:49,890 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5935025676836584846_1323 size 27493
2013-10-31 16:16:49,890 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml from client DFSClient_-1085102077
2013-10-31 16:16:49,891 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_conf.xml is closed by DFSClient_-1085102077
2013-10-31 16:16:49,891 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5935025676836584846_1323 size 27493
2013-10-31 16:16:49,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:16:49,904 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken. blk_-3308714215337688669_1324
2013-10-31 16:16:49,905 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3308714215337688669_1324 src: /127.0.0.1:36018 dest: /127.0.0.1:50942
2013-10-31 16:16:49,907 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3308714215337688669_1324 src: /127.0.0.1:56124 dest: /127.0.0.1:41648
2013-10-31 16:16:49,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3308714215337688669_1324 src: /127.0.0.1:36089 dest: /127.0.0.1:38271
2013-10-31 16:16:49,911 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36089, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3308714215337688669_1324, duration: 66537
2013-10-31 16:16:49,912 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3308714215337688669_1324 terminating
2013-10-31 16:16:49,912 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56124, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3308714215337688669_1324, duration: 831756
2013-10-31 16:16:49,912 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3308714215337688669_1324 terminating
2013-10-31 16:16:49,913 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3308714215337688669_1324 size 116
2013-10-31 16:16:49,913 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36018, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3308714215337688669_1324, duration: 1725198
2013-10-31 16:16:49,914 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3308714215337688669_1324 terminating
2013-10-31 16:16:49,916 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3308714215337688669_1324 size 116
2013-10-31 16:16:49,916 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken from client DFSClient_1457307213
2013-10-31 16:16:49,917 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken is closed by DFSClient_1457307213
2013-10-31 16:16:49,917 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3308714215337688669_1324 size 116
2013-10-31 16:16:49,922 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken
2013-10-31 16:16:49,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.splitmetainfo dst=null perm=null
2013-10-31 16:16:49,926 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36021, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7961768246826946218_1320, duration: 275335
2013-10-31 16:16:49,927 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0028 = 19. Number of splits = 5
2013-10-31 16:16:49,928 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,928 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,928 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,928 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,929 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,930 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0028_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:16:49,931 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0028 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:16:49,932 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0028 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:16:50,865 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6529624484255616460_1306 file build/test/data/dfs/data/data2/current/blk_-6529624484255616460 for deletion
2013-10-31 16:16:50,865 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2701757164713452030_1307 file build/test/data/dfs/data/data1/current/blk_-2701757164713452030 for deletion
2013-10-31 16:16:50,865 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6529624484255616460_1306 at file build/test/data/dfs/data/data2/current/blk_-6529624484255616460
2013-10-31 16:16:50,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2701757164713452030_1307 at file build/test/data/dfs/data/data1/current/blk_-2701757164713452030
2013-10-31 16:16:50,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6563616459556469136_1305 file build/test/data/dfs/data/data2/current/blk_6563616459556469136 for deletion
2013-10-31 16:16:50,867 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6563616459556469136_1305 at file build/test/data/dfs/data/data2/current/blk_6563616459556469136
2013-10-31 16:16:51,315 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-8815791525567125083_1318 to datanode(s) 127.0.0.1:38271
2013-10-31 16:16:51,316 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-7019503529854675644_1301 blk_-5924082644072865753_1303 blk_-9043489202376737003_1311 blk_-6262429360302313689_1304
2013-10-31 16:16:51,316 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-7019503529854675644_1301 blk_-5924082644072865753_1303 blk_-6262429360302313689_1304
2013-10-31 16:16:51,362 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0028_m_000006_0' to tip task_20131031160444934_0028_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:51,369 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000000_0'
2013-10-31 16:16:51,369 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000001_0'
2013-10-31 16:16:51,369 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000006_0'
2013-10-31 16:16:51,371 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:16:51,371 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000006_0 which needs 1 slots
2013-10-31 16:16:51,371 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000006_0 which needs 1 slots
2013-10-31 16:16:51,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken dst=null perm=null
2013-10-31 16:16:51,380 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36022, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3308714215337688669_1324, duration: 291948
2013-10-31 16:16:51,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml dst=null perm=null
2013-10-31 16:16:51,390 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36093, bytes: 27644, op: HDFS_READ, cliID: DFSClient_-1955750342, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 417875
2013-10-31 16:16:51,421 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:51,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar dst=null perm=null
2013-10-31 16:16:51,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36025, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1955750342, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8815791525567125083_1318, duration: 1236338
2013-10-31 16:16:51,465 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-8815791525567125083_1318 to 127.0.0.1:38271
2013-10-31 16:16:51,465 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7019503529854675644_1301 file build/test/data/dfs/data/data3/current/blk_-7019503529854675644 for deletion
2013-10-31 16:16:51,466 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6262429360302313689_1304 file build/test/data/dfs/data/data4/current/blk_-6262429360302313689 for deletion
2013-10-31 16:16:51,466 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7019503529854675644_1301 at file build/test/data/dfs/data/data3/current/blk_-7019503529854675644
2013-10-31 16:16:51,466 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5924082644072865753_1303 file build/test/data/dfs/data/data3/current/blk_-5924082644072865753 for deletion
2013-10-31 16:16:51,466 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6262429360302313689_1304 at file build/test/data/dfs/data/data4/current/blk_-6262429360302313689
2013-10-31 16:16:51,467 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5924082644072865753_1303 at file build/test/data/dfs/data/data3/current/blk_-5924082644072865753
2013-10-31 16:16:51,467 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8815791525567125083_1318 src: /127.0.0.1:36095 dest: /127.0.0.1:38271
2013-10-31 16:16:51,467 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-8815791525567125083_1318 to /127.0.0.1:38271
2013-10-31 16:16:51,470 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000002_0'
2013-10-31 16:16:51,470 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0027_m_000003_0'
2013-10-31 16:16:51,470 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8815791525567125083_1318 src: /127.0.0.1:36095 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:16:51,473 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8815791525567125083_1318 size 238055
2013-10-31 16:16:51,541 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:51,541 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0027 being deleted.
2013-10-31 16:16:51,563 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0027_m_404846204
2013-10-31 16:16:51,570 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26910 with signal TERM. Exit code 0
2013-10-31 16:16:51,570 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_-248337255
2013-10-31 16:16:51,571 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_-248337255 spawned.
2013-10-31 16:16:51,574 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000006_0/taskjvm.sh
2013-10-31 16:16:51,660 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:51,660 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:51,660 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:51,660 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_404846204 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:53,028 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_-248337255 given task: attempt_20131031160444934_0028_m_000006_0
2013-10-31 16:16:53,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:16:53,579 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:53,579 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000005_0 not found in cache
2013-10-31 16:16:53,579 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000004_0 not found in cache
2013-10-31 16:16:53,580 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0027 for user-log deletion with retainTimeStamp:1383322613580
2013-10-31 16:16:53,808 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1194820009 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:53,818 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27027 with signal TERM. Exit code 0
2013-10-31 16:16:53,865 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9043489202376737003_1311 file build/test/data/dfs/data/data1/current/blk_-9043489202376737003 for deletion
2013-10-31 16:16:53,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7019503529854675644_1301 file build/test/data/dfs/data/data2/current/blk_-7019503529854675644 for deletion
2013-10-31 16:16:53,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6262429360302313689_1304 file build/test/data/dfs/data/data1/current/blk_-6262429360302313689 for deletion
2013-10-31 16:16:53,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9043489202376737003_1311 at file build/test/data/dfs/data/data1/current/blk_-9043489202376737003
2013-10-31 16:16:53,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7019503529854675644_1301 at file build/test/data/dfs/data/data2/current/blk_-7019503529854675644
2013-10-31 16:16:53,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6262429360302313689_1304 at file build/test/data/dfs/data/data1/current/blk_-6262429360302313689
2013-10-31 16:16:53,866 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5924082644072865753_1303 file build/test/data/dfs/data/data2/current/blk_-5924082644072865753 for deletion
2013-10-31 16:16:53,867 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5924082644072865753_1303 at file build/test/data/dfs/data/data2/current/blk_-5924082644072865753
2013-10-31 16:16:54,021 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:54,021 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:54,022 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:54,022 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1194820009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:54,317 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-7019503529854675644_1301 blk_-9043489202376737003_1311
2013-10-31 16:16:54,317 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-5924082644072865753_1303 blk_-9043489202376737003_1311 blk_-6262429360302313689_1304
2013-10-31 16:16:54,941 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1344958877 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:54,951 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27254 with signal TERM. Exit code 0
2013-10-31 16:16:55,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9043489202376737003_1311 file build/test/data/dfs/data/data5/current/blk_-9043489202376737003 for deletion
2013-10-31 16:16:55,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7019503529854675644_1301 file build/test/data/dfs/data/data6/current/blk_-7019503529854675644 for deletion
2013-10-31 16:16:55,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9043489202376737003_1311 at file build/test/data/dfs/data/data5/current/blk_-9043489202376737003
2013-10-31 16:16:55,080 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7019503529854675644_1301 at file build/test/data/dfs/data/data6/current/blk_-7019503529854675644
2013-10-31 16:16:55,127 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:55,127 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:55,127 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:55,127 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1344958877 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:56,371 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:56,372 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000000_0 not found in cache
2013-10-31 16:16:56,372 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000001_0 not found in cache
2013-10-31 16:16:56,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0027 for user-log deletion with retainTimeStamp:1383322616373
2013-10-31 16:16:56,456 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000006_0 0.0% setup
2013-10-31 16:16:56,459 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000006_0 is done.
2013-10-31 16:16:56,459 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000006_0 was -1
2013-10-31 16:16:56,460 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:16:56,471 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0027
2013-10-31 16:16:56,471 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000002_0 not found in cache
2013-10-31 16:16:56,471 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0027_m_000003_0 not found in cache
2013-10-31 16:16:56,472 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0027 for user-log deletion with retainTimeStamp:1383322616472
2013-10-31 16:16:56,694 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_623587581 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:56,704 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26991 with signal TERM. Exit code 0
2013-10-31 16:16:56,802 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1289007788 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:56,813 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27026 with signal TERM. Exit code 0
2013-10-31 16:16:56,863 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0027_m_-1178212220 since job job_20131031160444934_0027 is dead
2013-10-31 16:16:56,867 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26758 with signal TERM. Exit code 0
2013-10-31 16:16:56,883 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:56,883 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:56,883 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:56,883 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_623587581 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:57,021 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:57,021 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:57,021 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:57,021 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1289007788 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:16:57,040 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:16:57,040 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:16:57,040 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:16:57,041 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0027_m_-1178212220 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:16:57,076 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9043489202376737003_1311 file build/test/data/dfs/data/data7/current/blk_-9043489202376737003 for deletion
2013-10-31 16:16:57,077 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6262429360302313689_1304 file build/test/data/dfs/data/data8/current/blk_-6262429360302313689 for deletion
2013-10-31 16:16:57,077 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9043489202376737003_1311 at file build/test/data/dfs/data/data7/current/blk_-9043489202376737003
2013-10-31 16:16:57,077 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6262429360302313689_1304 at file build/test/data/dfs/data/data8/current/blk_-6262429360302313689
2013-10-31 16:16:57,077 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5924082644072865753_1303 file build/test/data/dfs/data/data7/current/blk_-5924082644072865753 for deletion
2013-10-31 16:16:57,078 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5924082644072865753_1303 at file build/test/data/dfs/data/data7/current/blk_-5924082644072865753
2013-10-31 16:16:57,378 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000006_0' has completed task_20131031160444934_0028_m_000006 successfully.
2013-10-31 16:16:57,382 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000000_0' to tip task_20131031160444934_0028_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:57,384 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000000
2013-10-31 16:16:57,384 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000001_0' to tip task_20131031160444934_0028_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:16:57,385 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000001
2013-10-31 16:16:57,387 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:16:57,387 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:16:57,388 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000000_0 which needs 1 slots
2013-10-31 16:16:57,388 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000000_0 which needs 1 slots
2013-10-31 16:16:57,388 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000001_0 which needs 1 slots
2013-10-31 16:16:57,389 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0028_m_000001_0 which needs 1 slots
2013-10-31 16:16:57,426 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_1938196879
2013-10-31 16:16:57,427 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_1938196879 spawned.
2013-10-31 16:16:57,428 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0028/attempt_20131031160444934_0028_m_000001_0. Attempting to reuse: jvm_20131031160444934_0028_m_-248337255
2013-10-31 16:16:57,428 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000000_0/taskjvm.sh
2013-10-31 16:16:57,478 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000002_0' to tip task_20131031160444934_0028_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:57,478 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000002
2013-10-31 16:16:57,479 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000003_0' to tip task_20131031160444934_0028_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:16:57,501 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000003
2013-10-31 16:16:57,503 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:16:57,504 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:16:57,504 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000002_0 which needs 1 slots
2013-10-31 16:16:57,504 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000002_0 which needs 1 slots
2013-10-31 16:16:57,505 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000003_0 which needs 1 slots
2013-10-31 16:16:57,505 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0028_m_000003_0 which needs 1 slots
2013-10-31 16:16:57,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken dst=null perm=null
2013-10-31 16:16:57,512 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_-248337255 given task: attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:16:57,514 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36099, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3308714215337688669_1324, duration: 292012
2013-10-31 16:16:57,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml dst=null perm=null
2013-10-31 16:16:57,525 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36032, bytes: 27644, op: HDFS_READ, cliID: DFSClient_-265396891, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1002969834028224173_1321, duration: 448048
2013-10-31 16:16:57,546 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0028_m_000004_0' to tip task_20131031160444934_0028_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:16:57,546 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0028_m_000004
2013-10-31 16:16:57,549 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:16:57,549 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000004_0 which needs 1 slots
2013-10-31 16:16:57,549 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000004_0 which needs 1 slots
2013-10-31 16:16:57,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028/jobToken dst=null perm=null
2013-10-31 16:16:57,554 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56138, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3308714215337688669_1324, duration: 141720
2013-10-31 16:16:57,555 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:57,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.xml dst=null perm=null
2013-10-31 16:16:57,559 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36104, bytes: 27644, op: HDFS_READ, cliID: DFSClient_632657430, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1002969834028224173_1321, duration: 163419
2013-10-31 16:16:57,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar dst=null perm=null
2013-10-31 16:16:57,584 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:16:57,586 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36105, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-265396891, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8815791525567125083_1318, duration: 608894
2013-10-31 16:16:57,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.jar dst=null perm=null
2013-10-31 16:16:57,598 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36038, bytes: 239915, op: HDFS_READ, cliID: DFSClient_632657430, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8815791525567125083_1318, duration: 596288
2013-10-31 16:16:57,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=null
2013-10-31 16:16:57,639 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36039, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8399440944438708311_1319, duration: 542643
2013-10-31 16:16:57,641 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_1931396390
2013-10-31 16:16:57,642 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_1931396390 spawned.
2013-10-31 16:16:57,643 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_-887656516
2013-10-31 16:16:57,643 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_-887656516 spawned.
2013-10-31 16:16:57,644 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000003_0/taskjvm.sh
2013-10-31 16:16:57,644 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000002_0/taskjvm.sh
2013-10-31 16:16:57,654 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_594753817
2013-10-31 16:16:57,655 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_594753817 spawned.
2013-10-31 16:16:57,656 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000004_0/taskjvm.sh
2013-10-31 16:16:58,322 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_1938196879 given task: attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:16:59,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:00,264 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56146, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 288781
2013-10-31 16:17:00,282 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1730 Total time for transactions(ms): 37Number of transactions batched in Syncs: 183 Number of syncs: 1240 SyncTimes(ms): 52133 12336
2013-10-31 16:17:00,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:00,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:00,623 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001. blk_4468907177856788027_1325
2013-10-31 16:17:00,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4468907177856788027_1325 src: /127.0.0.1:56148 dest: /127.0.0.1:41648
2013-10-31 16:17:00,643 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4468907177856788027_1325 src: /127.0.0.1:36113 dest: /127.0.0.1:38271
2013-10-31 16:17:00,644 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4468907177856788027_1325 src: /127.0.0.1:49147 dest: /127.0.0.1:47311
2013-10-31 16:17:00,646 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49147, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4468907177856788027_1325, duration: 1433167
2013-10-31 16:17:00,646 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4468907177856788027_1325 terminating
2013-10-31 16:17:00,647 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36113, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 1784095
2013-10-31 16:17:00,647 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4468907177856788027_1325 terminating
2013-10-31 16:17:00,647 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56148, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4468907177856788027_1325, duration: 2279343
2013-10-31 16:17:00,647 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4468907177856788027_1325 terminating
2013-10-31 16:17:00,650 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4468907177856788027_1325 size 92
2013-10-31 16:17:00,651 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4468907177856788027_1325 size 92
2013-10-31 16:17:00,651 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4468907177856788027_1325 size 92
2013-10-31 16:17:00,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=null
2013-10-31 16:17:00,697 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36115, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8399440944438708311_1319, duration: 158602
2013-10-31 16:17:00,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:00,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:00,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:00,936 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36048, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 148177
2013-10-31 16:17:00,941 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000. blk_715915181680467880_1326
2013-10-31 16:17:00,974 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_715915181680467880_1326 src: /127.0.0.1:36049 dest: /127.0.0.1:50942
2013-10-31 16:17:00,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_715915181680467880_1326 src: /127.0.0.1:36119 dest: /127.0.0.1:38271
2013-10-31 16:17:00,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_715915181680467880_1326 src: /127.0.0.1:49153 dest: /127.0.0.1:47311
2013-10-31 16:17:00,978 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49153, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_715915181680467880_1326, duration: 1164592
2013-10-31 16:17:00,979 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_715915181680467880_1326 terminating
2013-10-31 16:17:00,979 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36119, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_715915181680467880_1326, duration: 1570349
2013-10-31 16:17:00,979 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_715915181680467880_1326 terminating
2013-10-31 16:17:00,979 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36049, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_715915181680467880_1326, duration: 1963875
2013-10-31 16:17:00,979 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_715915181680467880_1326 terminating
2013-10-31 16:17:00,981 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_715915181680467880_1326 size 92
2013-10-31 16:17:00,981 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_715915181680467880_1326 size 92
2013-10-31 16:17:00,982 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_715915181680467880_1326 size 92
2013-10-31 16:17:01,050 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:17:01,050 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:17:01,100 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:01,101 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 0.0%
2013-10-31 16:17:01,197 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_594753817 given task: attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:01,213 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_1931396390 given task: attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:01,229 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_-887656516 given task: attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:01,381 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:17:01,382 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:17:02,388 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0028_m_000006_0
2013-10-31 16:17:02,388 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0028_m_000006_0
2013-10-31 16:17:02,388 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000006_0 not found in cache
2013-10-31 16:17:03,390 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000001_0
2013-10-31 16:17:03,635 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:04,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0 dst=null perm=null
2013-10-31 16:17:04,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000001_0 dst=null perm=null
2013-10-31 16:17:04,328 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,328 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 0.0%
2013-10-31 16:17:04,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=null
2013-10-31 16:17:04,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=null
2013-10-31 16:17:04,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028/job.split dst=null perm=null
2013-10-31 16:17:04,362 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36058, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8399440944438708311_1319, duration: 171013
2013-10-31 16:17:04,363 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56164, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 512, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8399440944438708311_1319, duration: 320630
2013-10-31 16:17:04,368 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56165, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8399440944438708311_1319, duration: 330943
2013-10-31 16:17:04,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:04,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:04,403 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36061, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 324077
2013-10-31 16:17:04,404 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49164, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 255134
2013-10-31 16:17:04,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:04,410 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49165, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 149493
2013-10-31 16:17:04,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:04,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:04,617 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003. blk_8577440969405303007_1329
2013-10-31 16:17:04,624 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002. blk_777050699776076643_1329
2013-10-31 16:17:04,630 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004. blk_5223740880924984010_1329
2013-10-31 16:17:04,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8577440969405303007_1329 src: /127.0.0.1:36133 dest: /127.0.0.1:38271
2013-10-31 16:17:04,643 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8577440969405303007_1329 src: /127.0.0.1:36067 dest: /127.0.0.1:50942
2013-10-31 16:17:04,644 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8577440969405303007_1329 src: /127.0.0.1:49170 dest: /127.0.0.1:47311
2013-10-31 16:17:04,647 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49170, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8577440969405303007_1329, duration: 1428989
2013-10-31 16:17:04,649 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8577440969405303007_1329 terminating
2013-10-31 16:17:04,649 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777050699776076643_1329 src: /127.0.0.1:56170 dest: /127.0.0.1:41648
2013-10-31 16:17:04,649 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36067, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8577440969405303007_1329, duration: 4188607
2013-10-31 16:17:04,649 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8577440969405303007_1329 terminating
2013-10-31 16:17:04,649 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8577440969405303007_1329 size 92
2013-10-31 16:17:04,650 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36133, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8577440969405303007_1329, duration: 4754653
2013-10-31 16:17:04,650 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8577440969405303007_1329 size 92
2013-10-31 16:17:04,651 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8577440969405303007_1329 terminating
2013-10-31 16:17:04,650 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777050699776076643_1329 src: /127.0.0.1:36069 dest: /127.0.0.1:50942
2013-10-31 16:17:04,652 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777050699776076643_1329 src: /127.0.0.1:49172 dest: /127.0.0.1:47311
2013-10-31 16:17:04,653 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:04,653 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:04,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5223740880924984010_1329 src: /127.0.0.1:49168 dest: /127.0.0.1:47311
2013-10-31 16:17:04,654 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49172, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_777050699776076643_1329, duration: 1476550
2013-10-31 16:17:04,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5223740880924984010_1329 src: /127.0.0.1:36140 dest: /127.0.0.1:38271
2013-10-31 16:17:04,654 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_777050699776076643_1329 terminating
2013-10-31 16:17:04,654 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8577440969405303007_1329 size 92
2013-10-31 16:17:04,654 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36069, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 1707696
2013-10-31 16:17:04,657 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_777050699776076643_1329 terminating
2013-10-31 16:17:04,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5223740880924984010_1329 src: /127.0.0.1:36072 dest: /127.0.0.1:50942
2013-10-31 16:17:04,659 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56170, dest: /127.0.0.1:41648, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777050699776076643_1329, duration: 5727898
2013-10-31 16:17:04,659 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_777050699776076643_1329 size 92
2013-10-31 16:17:04,659 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_777050699776076643_1329 terminating
2013-10-31 16:17:04,659 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_777050699776076643_1329 size 92
2013-10-31 16:17:04,660 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_777050699776076643_1329 size 92
2013-10-31 16:17:04,661 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36072, dest: /127.0.0.1:50942, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 746261
2013-10-31 16:17:04,661 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5223740880924984010_1329 terminating
2013-10-31 16:17:04,661 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36140, dest: /127.0.0.1:38271, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5223740880924984010_1329, duration: 1049165
2013-10-31 16:17:04,661 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5223740880924984010_1329 terminating
2013-10-31 16:17:04,661 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49168, dest: /127.0.0.1:47311, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0028_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5223740880924984010_1329, duration: 1435727
2013-10-31 16:17:04,662 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:04,662 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5223740880924984010_1329 terminating
2013-10-31 16:17:04,662 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:04,663 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5223740880924984010_1329 size 92
2013-10-31 16:17:04,664 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5223740880924984010_1329 size 92
2013-10-31 16:17:04,664 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:04,664 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:04,665 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5223740880924984010_1329 size 92
2013-10-31 16:17:04,699 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,699 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000003_0 0.0%
2013-10-31 16:17:04,708 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,709 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000002_0 0.0%
2013-10-31 16:17:04,711 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0028_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:04,711 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000004_0 0.0%
2013-10-31 16:17:06,392 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000000_0
2013-10-31 16:17:06,510 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000002_0
2013-10-31 16:17:06,511 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000003_0
2013-10-31 16:17:06,554 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0028_m_000004_0
2013-10-31 16:17:06,666 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:06,680 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:06,682 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:06,683 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000001_0 is done.
2013-10-31 16:17:06,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000001_0 was -1
2013-10-31 16:17:06,684 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:06,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0 dst=null perm=null
2013-10-31 16:17:06,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:06,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0 dst=null perm=null
2013-10-31 16:17:06,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0 dst=null perm=null
2013-10-31 16:17:06,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:06,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:07,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0 dst=null perm=null
2013-10-31 16:17:07,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:07,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0/part-00004 dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:07,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000003_0 dst=null perm=null
2013-10-31 16:17:08,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000002_0 dst=null perm=null
2013-10-31 16:17:08,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000004_0 dst=null perm=null
2013-10-31 16:17:08,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary/_attempt_20131031160444934_0028_m_000000_0 dst=null perm=null
2013-10-31 16:17:09,397 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000001_0' has completed task_20131031160444934_0028_m_000001 successfully.
2013-10-31 16:17:09,740 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:09,743 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:09,744 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000000_0 is done.
2013-10-31 16:17:09,744 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000000_0 was -1
2013-10-31 16:17:09,744 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:10,309 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:17:10,309 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:17:10,309 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:17:10,310 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:17:10,310 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:17:10,311 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:17:10,311 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000004_0 is done.
2013-10-31 16:17:10,311 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000002_0 is done.
2013-10-31 16:17:10,311 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000004_0 was -1
2013-10-31 16:17:10,311 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000002_0 was -1
2013-10-31 16:17:10,312 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:10,312 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000003_0 is done.
2013-10-31 16:17:10,312 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000003_0 was -1
2013-10-31 16:17:10,312 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:10,312 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:12,403 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000000_0' has completed task_20131031160444934_0028_m_000000 successfully.
2013-10-31 16:17:12,518 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000002_0' has completed task_20131031160444934_0028_m_000002 successfully.
2013-10-31 16:17:12,519 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000003_0' has completed task_20131031160444934_0028_m_000003 successfully.
2013-10-31 16:17:12,561 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000004_0' has completed task_20131031160444934_0028_m_000004 successfully.
2013-10-31 16:17:12,564 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0028_m_000005_0' to tip task_20131031160444934_0028_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:17:12,566 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0028_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:17:12,567 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0028_m_000005_0 which needs 1 slots
2013-10-31 16:17:12,567 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0028_m_000005_0 which needs 1 slots
2013-10-31 16:17:12,604 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0028_m_790895765
2013-10-31 16:17:12,607 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0028_m_790895765 spawned.
2013-10-31 16:17:12,608 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0028/attempt_20131031160444934_0028_m_000005_0/taskjvm.sh
2013-10-31 16:17:13,574 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0028_m_790895765 given task: attempt_20131031160444934_0028_m_000005_0
2013-10-31 16:17:14,084 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000005_0 0.0%
2013-10-31 16:17:14,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_temporary dst=null perm=null
2013-10-31 16:17:14,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:14,112 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_SUCCESS from client DFSClient_attempt_20131031160444934_0028_m_000005_0
2013-10-31 16:17:14,113 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0028_m_000005_0
2013-10-31 16:17:14,120 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:14,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:14,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8815791525567125083 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:14,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8399440944438708311 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:14,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7961768246826946218 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7961768246826946218 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7961768246826946218 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:14,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1002969834028224173 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:14,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1002969834028224173 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:14,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1002969834028224173 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:14,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0028 dst=null perm=null
2013-10-31 16:17:15,320 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8399440944438708311_1319 blk_-7961768246826946218_1320 blk_-8815791525567125083_1318
2013-10-31 16:17:15,321 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_1002969834028224173_1321 blk_-8399440944438708311_1319 blk_-7961768246826946218_1320 blk_-8815791525567125083_1318
2013-10-31 16:17:16,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data6/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:16,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data5/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:16,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7961768246826946218_1320 file build/test/data/dfs/data/data6/current/blk_-7961768246826946218 for deletion
2013-10-31 16:17:16,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data6/current/blk_-8815791525567125083
2013-10-31 16:17:16,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data5/current/blk_-8399440944438708311
2013-10-31 16:17:16,087 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7961768246826946218_1320 at file build/test/data/dfs/data/data6/current/blk_-7961768246826946218
2013-10-31 16:17:17,020 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0028_m_000005_0 0.0% cleanup
2013-10-31 16:17:17,023 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0028_m_000005_0 is done.
2013-10-31 16:17:17,023 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0028_m_000005_0 was -1
2013-10-31 16:17:17,023 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:17,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data2/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:17,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data2/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7961768246826946218_1320 file build/test/data/dfs/data/data1/current/blk_-7961768246826946218 for deletion
2013-10-31 16:17:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data2/current/blk_-8815791525567125083
2013-10-31 16:17:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1002969834028224173_1321 file build/test/data/dfs/data/data2/current/blk_1002969834028224173 for deletion
2013-10-31 16:17:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data2/current/blk_-8399440944438708311
2013-10-31 16:17:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7961768246826946218_1320 at file build/test/data/dfs/data/data1/current/blk_-7961768246826946218
2013-10-31 16:17:17,876 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1002969834028224173_1321 at file build/test/data/dfs/data/data2/current/blk_1002969834028224173
2013-10-31 16:17:18,321 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_1002969834028224173_1321 blk_-8399440944438708311_1319 blk_-8815791525567125083_1318
2013-10-31 16:17:18,322 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_1002969834028224173_1321 blk_-8399440944438708311_1319 blk_-7961768246826946218_1320 blk_-8815791525567125083_1318
2013-10-31 16:17:18,474 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data4/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:18,474 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data3/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:18,474 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data4/current/blk_-8815791525567125083
2013-10-31 16:17:18,474 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data3/current/blk_-8399440944438708311
2013-10-31 16:17:18,474 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1002969834028224173_1321 file build/test/data/dfs/data/data4/current/blk_1002969834028224173 for deletion
2013-10-31 16:17:18,475 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1002969834028224173_1321 at file build/test/data/dfs/data/data4/current/blk_1002969834028224173
2013-10-31 16:17:18,574 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0028_m_000005_0' has completed task_20131031160444934_0028_m_000005 successfully.
2013-10-31 16:17:18,575 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0028 has completed successfully.
2013-10-31 16:17:18,576 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0028,submitTime=1383236209815,launchTime=1383236209931,firstMapTaskLaunchTime=1383236217382,firstJobSetupTaskLaunchTime=1383236211362,firstJobCleanupTaskLaunchTime=1383236232564,finishTime=1383236238575,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=69,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E4EC0E4BA2CD4E49B23EC80C191F27BB/B61C99E02A3D4FD9997CF14CD9C7325E] lower*upper1*upper2/(3/3)
2013-10-31 16:17:18,580 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9. blk_2852820014732100186_1330
2013-10-31 16:17:18,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2852820014732100186_1330 src: /127.0.0.1:36145 dest: /127.0.0.1:38271
2013-10-31 16:17:18,585 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2852820014732100186_1330 src: /127.0.0.1:49179 dest: /127.0.0.1:47311
2013-10-31 16:17:18,586 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2852820014732100186_1330 src: /127.0.0.1:36078 dest: /127.0.0.1:50942
2013-10-31 16:17:18,592 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36078, dest: /127.0.0.1:50942, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2852820014732100186_1330, duration: 2328098
2013-10-31 16:17:18,593 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2852820014732100186_1330 terminating
2013-10-31 16:17:18,593 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49179, dest: /127.0.0.1:47311, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2852820014732100186_1330, duration: 3836902
2013-10-31 16:17:18,594 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2852820014732100186_1330 terminating
2013-10-31 16:17:18,594 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36145, dest: /127.0.0.1:38271, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_-1085102077, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2852820014732100186_1330, duration: 4748716
2013-10-31 16:17:18,594 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2852820014732100186_1330 size 26339
2013-10-31 16:17:18,595 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2852820014732100186_1330 terminating
2013-10-31 16:17:18,596 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2852820014732100186_1330 size 26339
2013-10-31 16:17:18,599 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9 from client DFSClient_-1085102077
2013-10-31 16:17:18,599 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/_logs/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9 is closed by DFSClient_-1085102077
2013-10-31 16:17:18,600 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2852820014732100186_1330 size 26339
2013-10-31 16:17:18,608 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0028_1383236209815_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB61C99E02A3D4FD9 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:18,608 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000004_0'
2013-10-31 16:17:18,609 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000005_0'
2013-10-31 16:17:18,611 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3308714215337688669 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:18,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3308714215337688669 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:18,614 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:18,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3308714215337688669 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:18,614 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0028 being deleted.
2013-10-31 16:17:18,616 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (2/3)
2013-10-31 16:17:18,616 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0028_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:18,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0028 dst=null perm=null
2013-10-31 16:17:18,622 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:17:18,622 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:17:18,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:18,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:17:18,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,649 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar. blk_-5546483287794460021_1331
2013-10-31 16:17:18,650 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:36149 dest: /127.0.0.1:38271
2013-10-31 16:17:18,652 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:36081 dest: /127.0.0.1:50942
2013-10-31 16:17:18,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:56187 dest: /127.0.0.1:41648
2013-10-31 16:17:18,664 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56187, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5546483287794460021_1331, duration: 7494529
2013-10-31 16:17:18,665 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5546483287794460021_1331 terminating
2013-10-31 16:17:18,665 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:18,665 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36081, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5546483287794460021_1331, duration: 8410243
2013-10-31 16:17:18,666 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5546483287794460021_1331 terminating
2013-10-31 16:17:18,666 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36149, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5546483287794460021_1331, duration: 9329373
2013-10-31 16:17:18,667 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5546483287794460021_1331 terminating
2013-10-31 16:17:18,667 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:18,670 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar from client DFSClient_1457307213
2013-10-31 16:17:18,670 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar is closed by DFSClient_1457307213
2013-10-31 16:17:18,671 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:18,679 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar. New replication is 10
2013-10-31 16:17:18,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar dst=null perm=null
2013-10-31 16:17:18,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,692 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:17:18,696 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:17:18,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:18,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,711 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split. New replication is 10
2013-10-31 16:17:18,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=null
2013-10-31 16:17:18,717 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split. blk_6818519663719605632_1332
2013-10-31 16:17:18,719 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:36152 dest: /127.0.0.1:38271
2013-10-31 16:17:18,721 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:56189 dest: /127.0.0.1:41648
2013-10-31 16:17:18,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:36085 dest: /127.0.0.1:50942
2013-10-31 16:17:18,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6818519663719605632_1332 src: /127.0.0.1:49188 dest: /127.0.0.1:47311
2013-10-31 16:17:18,727 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49188, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 85386
2013-10-31 16:17:18,728 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,728 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36085, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6818519663719605632_1332, duration: 858343
2013-10-31 16:17:18,728 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,729 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56189, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6818519663719605632_1332, duration: 1759486
2013-10-31 16:17:18,729 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,730 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36152, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6818519663719605632_1332, duration: 2559698
2013-10-31 16:17:18,730 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6818519663719605632_1332 terminating
2013-10-31 16:17:18,733 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,733 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split from client DFSClient_1457307213
2013-10-31 16:17:18,734 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split is closed by DFSClient_1457307213
2013-10-31 16:17:18,734 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,734 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,735 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6818519663719605632_1332 size 1732
2013-10-31 16:17:18,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,751 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo. blk_-2835549027426087773_1333
2013-10-31 16:17:18,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2835549027426087773_1333 src: /127.0.0.1:56192 dest: /127.0.0.1:41648
2013-10-31 16:17:18,754 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2835549027426087773_1333 src: /127.0.0.1:36088 dest: /127.0.0.1:50942
2013-10-31 16:17:18,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2835549027426087773_1333 src: /127.0.0.1:49191 dest: /127.0.0.1:47311
2013-10-31 16:17:18,758 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49191, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2835549027426087773_1333, duration: 64856
2013-10-31 16:17:18,759 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2835549027426087773_1333 terminating
2013-10-31 16:17:18,759 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36088, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2835549027426087773_1333, duration: 889809
2013-10-31 16:17:18,760 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2835549027426087773_1333 terminating
2013-10-31 16:17:18,760 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56192, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2835549027426087773_1333, duration: 1704172
2013-10-31 16:17:18,760 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2835549027426087773_1333 size 183
2013-10-31 16:17:18,761 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2835549027426087773_1333 terminating
2013-10-31 16:17:18,762 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2835549027426087773_1333 size 183
2013-10-31 16:17:18,763 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2835549027426087773_1333 size 183
2013-10-31 16:17:18,763 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:17:18,764 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:17:18,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:18,786 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml. blk_4320670473446602513_1334
2013-10-31 16:17:18,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4320670473446602513_1334 src: /127.0.0.1:56195 dest: /127.0.0.1:41648
2013-10-31 16:17:18,789 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4320670473446602513_1334 src: /127.0.0.1:36091 dest: /127.0.0.1:50942
2013-10-31 16:17:18,791 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4320670473446602513_1334 src: /127.0.0.1:36161 dest: /127.0.0.1:38271
2013-10-31 16:17:18,794 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36161, dest: /127.0.0.1:38271, bytes: 28564, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4320670473446602513_1334, duration: 213189
2013-10-31 16:17:18,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4320670473446602513_1334 size 28564
2013-10-31 16:17:18,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4320670473446602513_1334 terminating
2013-10-31 16:17:18,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36091, dest: /127.0.0.1:50942, bytes: 28564, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 1163232
2013-10-31 16:17:18,796 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4320670473446602513_1334 terminating
2013-10-31 16:17:18,796 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56195, dest: /127.0.0.1:41648, bytes: 28564, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4320670473446602513_1334, duration: 2299839
2013-10-31 16:17:18,796 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4320670473446602513_1334 size 28564
2013-10-31 16:17:18,797 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4320670473446602513_1334 terminating
2013-10-31 16:17:18,799 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4320670473446602513_1334 size 28564
2013-10-31 16:17:18,799 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml from client DFSClient_1457307213
2013-10-31 16:17:18,800 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml is closed by DFSClient_1457307213
2013-10-31 16:17:19,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml dst=null perm=null
2013-10-31 16:17:19,391 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36094, bytes: 28788, op: HDFS_READ, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 474259
2013-10-31 16:17:19,410 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0029: nMaps=5 nReduces=0 max=-1
2013-10-31 16:17:19,410 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0029 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:17:19,411 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0029
2013-10-31 16:17:19,411 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0029 RESULT=SUCCESS
2013-10-31 16:17:19,411 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0029
2013-10-31 16:17:19,412 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0029
2013-10-31 16:17:19,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:19,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:19,447 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml. blk_7470160298863947644_1336
2013-10-31 16:17:19,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7470160298863947644_1336 src: /127.0.0.1:49197 dest: /127.0.0.1:47311
2013-10-31 16:17:19,450 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7470160298863947644_1336 src: /127.0.0.1:56201 dest: /127.0.0.1:41648
2013-10-31 16:17:19,452 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7470160298863947644_1336 src: /127.0.0.1:36097 dest: /127.0.0.1:50942
2013-10-31 16:17:19,456 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36097, dest: /127.0.0.1:50942, bytes: 28629, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7470160298863947644_1336, duration: 502817
2013-10-31 16:17:19,456 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7470160298863947644_1336 terminating
2013-10-31 16:17:19,457 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56201, dest: /127.0.0.1:41648, bytes: 28629, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7470160298863947644_1336, duration: 1854336
2013-10-31 16:17:19,457 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7470160298863947644_1336 terminating
2013-10-31 16:17:19,458 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49197, dest: /127.0.0.1:47311, bytes: 28629, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7470160298863947644_1336, duration: 2316954
2013-10-31 16:17:19,458 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7470160298863947644_1336 terminating
2013-10-31 16:17:19,462 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7470160298863947644_1336 size 28629
2013-10-31 16:17:19,462 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml from client DFSClient_-350050235
2013-10-31 16:17:19,463 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_conf.xml is closed by DFSClient_-350050235
2013-10-31 16:17:19,463 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7470160298863947644_1336 size 28629
2013-10-31 16:17:19,463 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7470160298863947644_1336 size 28629
2013-10-31 16:17:19,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:19,477 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken. blk_-1641886665873571422_1337
2013-10-31 16:17:19,479 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1641886665873571422_1337 src: /127.0.0.1:36167 dest: /127.0.0.1:38271
2013-10-31 16:17:19,480 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1641886665873571422_1337 src: /127.0.0.1:49201 dest: /127.0.0.1:47311
2013-10-31 16:17:19,482 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1641886665873571422_1337 src: /127.0.0.1:56205 dest: /127.0.0.1:41648
2013-10-31 16:17:19,485 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56205, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1641886665873571422_1337, duration: 406759
2013-10-31 16:17:19,485 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1641886665873571422_1337 terminating
2013-10-31 16:17:19,486 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49201, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1641886665873571422_1337, duration: 1139611
2013-10-31 16:17:19,486 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1641886665873571422_1337 terminating
2013-10-31 16:17:19,487 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36167, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1641886665873571422_1337, duration: 2014838
2013-10-31 16:17:19,487 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1641886665873571422_1337 terminating
2013-10-31 16:17:19,490 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1641886665873571422_1337 size 116
2013-10-31 16:17:19,490 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1641886665873571422_1337 size 116
2013-10-31 16:17:19,490 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1641886665873571422_1337 size 116
2013-10-31 16:17:19,890 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken from client DFSClient_1457307213
2013-10-31 16:17:19,891 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken is closed by DFSClient_1457307213
2013-10-31 16:17:19,896 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken
2013-10-31 16:17:19,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.splitmetainfo dst=null perm=null
2013-10-31 16:17:19,900 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36101, bytes: 187, op: HDFS_READ, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2835549027426087773_1333, duration: 269902
2013-10-31 16:17:19,901 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0029 = 19. Number of splits = 5
2013-10-31 16:17:19,902 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,902 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,902 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,902 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,903 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,904 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,905 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,905 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0029_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:19,905 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0029 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:17:19,906 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0029 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:17:21,085 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8815791525567125083_1318 file build/test/data/dfs/data/data8/current/blk_-8815791525567125083 for deletion
2013-10-31 16:17:21,085 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8399440944438708311_1319 file build/test/data/dfs/data/data7/current/blk_-8399440944438708311 for deletion
2013-10-31 16:17:21,085 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7961768246826946218_1320 file build/test/data/dfs/data/data8/current/blk_-7961768246826946218 for deletion
2013-10-31 16:17:21,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8399440944438708311_1319 at file build/test/data/dfs/data/data7/current/blk_-8399440944438708311
2013-10-31 16:17:21,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1002969834028224173_1321 file build/test/data/dfs/data/data7/current/blk_1002969834028224173 for deletion
2013-10-31 16:17:21,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8815791525567125083_1318 at file build/test/data/dfs/data/data8/current/blk_-8815791525567125083
2013-10-31 16:17:21,086 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1002969834028224173_1321 at file build/test/data/dfs/data/data7/current/blk_1002969834028224173
2013-10-31 16:17:21,087 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7961768246826946218_1320 at file build/test/data/dfs/data/data8/current/blk_-7961768246826946218
2013-10-31 16:17:21,323 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-5546483287794460021_1331 to datanode(s) 127.0.0.1:47311
2013-10-31 16:17:21,323 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-3308714215337688669_1324
2013-10-31 16:17:21,323 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-3308714215337688669_1324
2013-10-31 16:17:21,416 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0029_m_000006_0' to tip task_20131031160444934_0029_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:21,423 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000000_0'
2013-10-31 16:17:21,423 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000001_0'
2013-10-31 16:17:21,423 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000006_0'
2013-10-31 16:17:21,425 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:17:21,426 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000006_0 which needs 1 slots
2013-10-31 16:17:21,426 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000006_0 which needs 1 slots
2013-10-31 16:17:21,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken dst=null perm=null
2013-10-31 16:17:21,434 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36171, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1641886665873571422_1337, duration: 296908
2013-10-31 16:17:21,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml dst=null perm=null
2013-10-31 16:17:21,448 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36173, bytes: 28788, op: HDFS_READ, cliID: DFSClient_556233743, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4320670473446602513_1334, duration: 387239
2013-10-31 16:17:21,475 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:21,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar dst=null perm=null
2013-10-31 16:17:21,508 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36105, bytes: 239915, op: HDFS_READ, cliID: DFSClient_556233743, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5546483287794460021_1331, duration: 1490884
2013-10-31 16:17:21,529 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000002_0'
2013-10-31 16:17:21,530 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0028_m_000003_0'
2013-10-31 16:17:21,602 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0028_m_1938196879
2013-10-31 16:17:21,609 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27570 with signal TERM. Exit code 0
2013-10-31 16:17:21,609 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-90922477
2013-10-31 16:17:21,610 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-90922477 spawned.
2013-10-31 16:17:21,611 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000006_0/taskjvm.sh
2013-10-31 16:17:22,086 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:22,086 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:22,086 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:22,086 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_1938196879 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:22,087 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3308714215337688669_1324 file build/test/data/dfs/data/data6/current/blk_-3308714215337688669 for deletion
2013-10-31 16:17:22,087 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3308714215337688669_1324 at file build/test/data/dfs/data/data6/current/blk_-3308714215337688669
2013-10-31 16:17:22,827 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-90922477 given task: attempt_20131031160444934_0029_m_000006_0
2013-10-31 16:17:23,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:23,611 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:23,611 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000004_0 not found in cache
2013-10-31 16:17:23,611 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000005_0 not found in cache
2013-10-31 16:17:23,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0028 for user-log deletion with retainTimeStamp:1383322643612
2013-10-31 16:17:23,876 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3308714215337688669_1324 file build/test/data/dfs/data/data1/current/blk_-3308714215337688669 for deletion
2013-10-31 16:17:23,876 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3308714215337688669_1324 at file build/test/data/dfs/data/data1/current/blk_-3308714215337688669
2013-10-31 16:17:24,106 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-5546483287794460021_1331 to 127.0.0.1:47311
2013-10-31 16:17:24,108 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5546483287794460021_1331 src: /127.0.0.1:49210 dest: /127.0.0.1:47311
2013-10-31 16:17:24,108 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-5546483287794460021_1331 to /127.0.0.1:47311
2013-10-31 16:17:24,111 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5546483287794460021_1331 src: /127.0.0.1:49210 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:17:24,116 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5546483287794460021_1331 size 238055
2013-10-31 16:17:24,324 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-3308714215337688669_1324
2013-10-31 16:17:24,349 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_594753817 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:24,359 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27676 with signal TERM. Exit code 0
2013-10-31 16:17:24,595 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:24,595 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:24,595 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:24,595 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_594753817 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:25,076 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_790895765 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:25,086 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27912 with signal TERM. Exit code 0
2013-10-31 16:17:25,260 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:25,261 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:25,261 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:25,261 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_790895765 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:26,272 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000006_0 0.0% setup
2013-10-31 16:17:26,275 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000006_0 is done.
2013-10-31 16:17:26,276 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000006_0 was -1
2013-10-31 16:17:26,276 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:26,426 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:26,426 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000000_0 not found in cache
2013-10-31 16:17:26,427 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000001_0 not found in cache
2013-10-31 16:17:26,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0028 for user-log deletion with retainTimeStamp:1383322646427
2013-10-31 16:17:26,530 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0028
2013-10-31 16:17:26,531 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000002_0 not found in cache
2013-10-31 16:17:26,531 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0028_m_000003_0 not found in cache
2013-10-31 16:17:26,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0028 for user-log deletion with retainTimeStamp:1383322646531
2013-10-31 16:17:26,732 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_-248337255 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:26,742 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27429 with signal TERM. Exit code 0
2013-10-31 16:17:26,983 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:26,983 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:26,983 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:26,983 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_-248337255 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:17:27,087 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3308714215337688669_1324 file build/test/data/dfs/data/data7/current/blk_-3308714215337688669 for deletion
2013-10-31 16:17:27,087 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3308714215337688669_1324 at file build/test/data/dfs/data/data7/current/blk_-3308714215337688669
2013-10-31 16:17:27,350 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_1931396390 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:27,360 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27659 with signal TERM. Exit code 0
2013-10-31 16:17:27,360 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0028_m_-887656516 since job job_20131031160444934_0028 is dead
2013-10-31 16:17:27,371 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27677 with signal TERM. Exit code 0
2013-10-31 16:17:27,431 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000006_0' has completed task_20131031160444934_0029_m_000006 successfully.
2013-10-31 16:17:27,432 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000000_0' to tip task_20131031160444934_0029_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:27,433 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000000
2013-10-31 16:17:27,433 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000001_0' to tip task_20131031160444934_0029_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:27,433 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000001
2013-10-31 16:17:27,434 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:17:27,435 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:17:27,435 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000000_0 which needs 1 slots
2013-10-31 16:17:27,435 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000000_0 which needs 1 slots
2013-10-31 16:17:27,435 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000001_0 which needs 1 slots
2013-10-31 16:17:27,436 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0029_m_000001_0 which needs 1 slots
2013-10-31 16:17:27,464 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1440454458
2013-10-31 16:17:27,464 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1440454458 spawned.
2013-10-31 16:17:27,465 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000000_0/taskjvm.sh
2013-10-31 16:17:27,468 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0029/attempt_20131031160444934_0029_m_000001_0. Attempting to reuse: jvm_20131031160444934_0029_m_-90922477
2013-10-31 16:17:27,538 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000002_0' to tip task_20131031160444934_0029_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:17:27,538 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000002
2013-10-31 16:17:27,539 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000003_0' to tip task_20131031160444934_0029_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:17:27,540 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000003
2013-10-31 16:17:27,543 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:17:27,544 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:17:27,544 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000002_0 which needs 1 slots
2013-10-31 16:17:27,544 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000002_0 which needs 1 slots
2013-10-31 16:17:27,544 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000003_0 which needs 1 slots
2013-10-31 16:17:27,544 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0029_m_000003_0 which needs 1 slots
2013-10-31 16:17:27,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken dst=null perm=null
2013-10-31 16:17:27,550 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56215, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1641886665873571422_1337, duration: 320134
2013-10-31 16:17:27,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml dst=null perm=null
2013-10-31 16:17:27,555 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:27,555 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:27,555 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:27,555 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_-887656516 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:27,556 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36112, bytes: 28788, op: HDFS_READ, cliID: DFSClient_1171540499, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 187382
2013-10-31 16:17:27,561 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:27,561 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:27,561 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:27,561 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0028_m_1931396390 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:27,569 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:27,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar dst=null perm=null
2013-10-31 16:17:27,583 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36182, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1171540499, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5546483287794460021_1331, duration: 600858
2013-10-31 16:17:27,619 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0029_m_000004_0' to tip task_20131031160444934_0029_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:17:27,620 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0029_m_000004
2013-10-31 16:17:27,621 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:17:27,621 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000004_0 which needs 1 slots
2013-10-31 16:17:27,621 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000004_0 which needs 1 slots
2013-10-31 16:17:27,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029/jobToken dst=null perm=null
2013-10-31 16:17:27,624 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49216, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1641886665873571422_1337, duration: 140171
2013-10-31 16:17:27,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.xml dst=null perm=null
2013-10-31 16:17:27,629 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36116, bytes: 28788, op: HDFS_READ, cliID: DFSClient_-1481985332, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4320670473446602513_1334, duration: 163725
2013-10-31 16:17:27,636 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1587966514
2013-10-31 16:17:27,637 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1587966514 spawned.
2013-10-31 16:17:27,637 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1214579449
2013-10-31 16:17:27,639 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1214579449 spawned.
2013-10-31 16:17:27,639 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000003_0/taskjvm.sh
2013-10-31 16:17:27,640 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000002_0/taskjvm.sh
2013-10-31 16:17:27,837 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-90922477 given task: attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:27,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=null
2013-10-31 16:17:27,937 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56223, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6818519663719605632_1332, duration: 168890
2013-10-31 16:17:27,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:27,976 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36119, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 101577
2013-10-31 16:17:28,314 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1440454458 given task: attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:28,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=null
2013-10-31 16:17:28,809 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49224, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 164749
2013-10-31 16:17:28,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:30,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:30,146 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:30,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.jar dst=null perm=null
2013-10-31 16:17:30,161 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 75 raw values into 1 aggregated values, total 7
2013-10-31 16:17:30,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36123, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1481985332, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5546483287794460021_1331, duration: 890196
2013-10-31 16:17:30,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:30,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:30,240 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0029_m_-1171757031
2013-10-31 16:17:30,241 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0029_m_-1171757031 spawned.
2013-10-31 16:17:30,242 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0029/attempt_20131031160444934_0029_m_000004_0/taskjvm.sh
2013-10-31 16:17:30,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:30,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=null
2013-10-31 16:17:30,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:30,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:30,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:30,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:30,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:30,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=null
2013-10-31 16:17:30,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:30,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:30,644 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36124, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_715915181680467880_1326, duration: 136130
2013-10-31 16:17:30,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:30,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:30,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:30,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:30,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:30,652 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56230, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4468907177856788027_1325, duration: 133031
2013-10-31 16:17:30,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:30,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:30,655 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56231, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777050699776076643_1329, duration: 116880
2013-10-31 16:17:30,655 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36196, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_715915181680467880_1326, duration: 108809
2013-10-31 16:17:30,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:30,658 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36128, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8577440969405303007_1329, duration: 105433
2013-10-31 16:17:30,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:30,660 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36198, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5223740880924984010_1329, duration: 99254
2013-10-31 16:17:30,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:30,664 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49232, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4468907177856788027_1325, duration: 114029
2013-10-31 16:17:30,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:30,667 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36131, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 102340
2013-10-31 16:17:30,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:30,669 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001. blk_7018752213662655129_1339
2013-10-31 16:17:30,670 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36201, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8577440969405303007_1329, duration: 106317
2013-10-31 16:17:30,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:30,674 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36134, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 98896
2013-10-31 16:17:30,677 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56240, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 101594
2013-10-31 16:17:30,684 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000. blk_-1663768746748666765_1339
2013-10-31 16:17:30,688 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7018752213662655129_1339 src: /127.0.0.1:49235 dest: /127.0.0.1:47311
2013-10-31 16:17:30,689 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7018752213662655129_1339 src: /127.0.0.1:36206 dest: /127.0.0.1:38271
2013-10-31 16:17:30,690 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7018752213662655129_1339 src: /127.0.0.1:56243 dest: /127.0.0.1:41648
2013-10-31 16:17:30,692 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56243, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7018752213662655129_1339, duration: 1383497
2013-10-31 16:17:30,693 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7018752213662655129_1339 terminating
2013-10-31 16:17:30,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7018752213662655129_1339 size 104
2013-10-31 16:17:30,693 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36206, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7018752213662655129_1339, duration: 1947938
2013-10-31 16:17:30,693 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7018752213662655129_1339 terminating
2013-10-31 16:17:30,693 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49235, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7018752213662655129_1339, duration: 2462348
2013-10-31 16:17:30,693 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7018752213662655129_1339 terminating
2013-10-31 16:17:30,695 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:30,698 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:30,699 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7018752213662655129_1339 size 104
2013-10-31 16:17:30,699 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7018752213662655129_1339 size 104
2013-10-31 16:17:30,707 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1663768746748666765_1339 src: /127.0.0.1:49238 dest: /127.0.0.1:47311
2013-10-31 16:17:30,708 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1663768746748666765_1339 src: /127.0.0.1:56244 dest: /127.0.0.1:41648
2013-10-31 16:17:30,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1663768746748666765_1339 src: /127.0.0.1:36140 dest: /127.0.0.1:50942
2013-10-31 16:17:30,711 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36140, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1663768746748666765_1339, duration: 1213911
2013-10-31 16:17:30,712 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1663768746748666765_1339 terminating
2013-10-31 16:17:30,712 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1663768746748666765_1339 size 104
2013-10-31 16:17:30,712 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56244, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1663768746748666765_1339, duration: 1564587
2013-10-31 16:17:30,712 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1663768746748666765_1339 terminating
2013-10-31 16:17:30,712 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49238, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 2009110
2013-10-31 16:17:30,712 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1663768746748666765_1339 terminating
2013-10-31 16:17:30,713 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:30,714 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:30,714 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1663768746748666765_1339 size 104
2013-10-31 16:17:30,716 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1663768746748666765_1339 size 104
2013-10-31 16:17:30,740 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:30,740 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 0.0%
2013-10-31 16:17:30,771 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:30,771 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000000_0 0.0%
2013-10-31 16:17:31,012 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1587966514 given task: attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:31,219 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1214579449 given task: attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:31,387 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-1171757031 given task: attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:31,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=null
2013-10-31 16:17:31,507 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49248, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 164844
2013-10-31 16:17:31,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:31,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36147, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 136049
2013-10-31 16:17:31,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:31,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:31,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=null
2013-10-31 16:17:31,738 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49251, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6818519663719605632_1332, duration: 364551
2013-10-31 16:17:31,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:31,779 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56255, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 268002
2013-10-31 16:17:31,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:31,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=null
2013-10-31 16:17:31,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:31,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:31,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:31,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:31,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:31,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:31,813 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49253, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_715915181680467880_1326, duration: 136349
2013-10-31 16:17:31,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:31,822 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36221, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 103590
2013-10-31 16:17:31,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:31,824 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56258, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777050699776076643_1329, duration: 113590
2013-10-31 16:17:31,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:31,827 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36223, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8577440969405303007_1329, duration: 102815
2013-10-31 16:17:31,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:31,830 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36224, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5223740880924984010_1329, duration: 101063
2013-10-31 16:17:32,167 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003. blk_6018207326177541389_1341
2013-10-31 16:17:32,201 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6018207326177541389_1341 src: /127.0.0.1:36157 dest: /127.0.0.1:50942
2013-10-31 16:17:32,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6018207326177541389_1341 src: /127.0.0.1:49260 dest: /127.0.0.1:47311
2013-10-31 16:17:32,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6018207326177541389_1341 src: /127.0.0.1:36228 dest: /127.0.0.1:38271
2013-10-31 16:17:32,223 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36228, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6018207326177541389_1341, duration: 1355152
2013-10-31 16:17:32,223 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6018207326177541389_1341 terminating
2013-10-31 16:17:32,223 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49260, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6018207326177541389_1341, duration: 1471414
2013-10-31 16:17:32,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6018207326177541389_1341 terminating
2013-10-31 16:17:32,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36157, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6018207326177541389_1341, duration: 2322780
2013-10-31 16:17:32,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6018207326177541389_1341 terminating
2013-10-31 16:17:32,226 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6018207326177541389_1341 size 104
2013-10-31 16:17:32,227 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6018207326177541389_1341 size 104
2013-10-31 16:17:32,227 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6018207326177541389_1341 size 104
2013-10-31 16:17:32,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029/job.split dst=null perm=null
2013-10-31 16:17:32,259 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36229, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6818519663719605632_1332, duration: 427676
2013-10-31 16:17:32,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:17:32,302 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49263, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 248505
2013-10-31 16:17:32,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:32,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:32,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:32,435 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0029_m_000006_0
2013-10-31 16:17:32,436 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0029_m_000006_0
2013-10-31 16:17:32,436 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000006_0 not found in cache
2013-10-31 16:17:32,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=null
2013-10-31 16:17:32,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:32,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:32,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:32,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:32,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:32,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:32,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36162, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_715915181680467880_1326, duration: 130910
2013-10-31 16:17:32,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:32,566 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36232, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 107643
2013-10-31 16:17:32,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:32,569 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36164, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 100478
2013-10-31 16:17:32,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:32,572 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49267, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8577440969405303007_1329, duration: 100458
2013-10-31 16:17:32,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:32,575 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36166, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 100154
2013-10-31 16:17:32,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=null
2013-10-31 16:17:32,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:32,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:32,584 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002. blk_-4668368595109805817_1342
2013-10-31 16:17:32,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:32,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:32,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:32,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00000 dst=null perm=null
2013-10-31 16:17:32,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36237, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_715915181680467880_1326, duration: 129935
2013-10-31 16:17:32,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00001 dst=null perm=null
2013-10-31 16:17:32,600 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36238, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4468907177856788027_1325, duration: 109826
2013-10-31 16:17:32,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00002 dst=null perm=null
2013-10-31 16:17:32,604 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36170, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777050699776076643_1329, duration: 100608
2013-10-31 16:17:32,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00003 dst=null perm=null
2013-10-31 16:17:32,606 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36171, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8577440969405303007_1329, duration: 125734
2013-10-31 16:17:32,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4668368595109805817_1342 src: /127.0.0.1:56272 dest: /127.0.0.1:41648
2013-10-31 16:17:32,608 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4668368595109805817_1342 src: /127.0.0.1:36172 dest: /127.0.0.1:50942
2013-10-31 16:17:32,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91/part-00004 dst=null perm=null
2013-10-31 16:17:32,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4668368595109805817_1342 src: /127.0.0.1:49275 dest: /127.0.0.1:47311
2013-10-31 16:17:32,609 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36174, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5223740880924984010_1329, duration: 104286
2013-10-31 16:17:32,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49275, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4668368595109805817_1342, duration: 1031625
2013-10-31 16:17:32,611 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4668368595109805817_1342 terminating
2013-10-31 16:17:32,611 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4668368595109805817_1342 size 104
2013-10-31 16:17:32,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36172, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4668368595109805817_1342, duration: 1492502
2013-10-31 16:17:32,612 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4668368595109805817_1342 terminating
2013-10-31 16:17:32,612 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56272, dest: /127.0.0.1:41648, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 1945548
2013-10-31 16:17:32,612 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4668368595109805817_1342 terminating
2013-10-31 16:17:32,613 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:32,613 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:32,614 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4668368595109805817_1342 size 104
2013-10-31 16:17:32,616 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4668368595109805817_1342 size 104
2013-10-31 16:17:32,619 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004. blk_-1513594355081957583_1342
2013-10-31 16:17:32,626 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:32,627 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:32,641 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1513594355081957583_1342 src: /127.0.0.1:36175 dest: /127.0.0.1:50942
2013-10-31 16:17:32,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1513594355081957583_1342 src: /127.0.0.1:49278 dest: /127.0.0.1:47311
2013-10-31 16:17:32,643 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1513594355081957583_1342 src: /127.0.0.1:36246 dest: /127.0.0.1:38271
2013-10-31 16:17:32,645 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36246, dest: /127.0.0.1:38271, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1513594355081957583_1342, duration: 1010123
2013-10-31 16:17:32,645 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1513594355081957583_1342 terminating
2013-10-31 16:17:32,645 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49278, dest: /127.0.0.1:47311, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1513594355081957583_1342, duration: 1493953
2013-10-31 16:17:32,645 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1513594355081957583_1342 terminating
2013-10-31 16:17:32,645 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36175, dest: /127.0.0.1:50942, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0029_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 1844026
2013-10-31 16:17:32,646 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1513594355081957583_1342 terminating
2013-10-31 16:17:32,646 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1513594355081957583_1342 size 104
2013-10-31 16:17:32,646 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:32,647 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:32,649 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1513594355081957583_1342 size 104
2013-10-31 16:17:32,649 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1513594355081957583_1342 size 104
2013-10-31 16:17:32,660 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:32,660 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000002_0 0.0%
2013-10-31 16:17:32,682 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:32,682 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000003_0 0.0%
2013-10-31 16:17:32,693 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0029_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:32,694 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000004_0 0.0%
2013-10-31 16:17:33,438 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000000_0
2013-10-31 16:17:33,438 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000001_0
2013-10-31 16:17:33,547 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000002_0
2013-10-31 16:17:33,548 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000003_0
2013-10-31 16:17:33,623 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0029_m_000004_0
2013-10-31 16:17:33,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0 dst=null perm=null
2013-10-31 16:17:33,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0 dst=null perm=null
2013-10-31 16:17:33,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0 dst=null perm=null
2013-10-31 16:17:33,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0 dst=null perm=null
2013-10-31 16:17:33,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0 dst=null perm=null
2013-10-31 16:17:33,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:33,930 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:33,983 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7127116701397707812_1204
2013-10-31 16:17:34,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0/part-00004 dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:34,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000002_0 dst=null perm=null
2013-10-31 16:17:34,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000003_0 dst=null perm=null
2013-10-31 16:17:34,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000004_0 dst=null perm=null
2013-10-31 16:17:34,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000001_0 dst=null perm=null
2013-10-31 16:17:34,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary/_attempt_20131031160444934_0029_m_000000_0 dst=null perm=null
2013-10-31 16:17:34,435 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:12+4
2013-10-31 16:17:34,436 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000003_0 is done.
2013-10-31 16:17:34,437 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000003_0 was -1
2013-10-31 16:17:34,437 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:34,658 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:8+4
2013-10-31 16:17:34,659 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000002_0 is done.
2013-10-31 16:17:34,659 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000002_0 was -1
2013-10-31 16:17:34,659 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:34,796 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:34,799 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:0+4
2013-10-31 16:17:34,800 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000000_0 is done.
2013-10-31 16:17:34,800 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000000_0 was -1
2013-10-31 16:17:34,800 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:35,172 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:16+3
2013-10-31 16:17:35,173 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000004_0 is done.
2013-10-31 16:17:35,174 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000004_0 was -1
2013-10-31 16:17:35,174 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:36,442 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000000_0' has completed task_20131031160444934_0029_m_000000 successfully.
2013-10-31 16:17:36,552 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000002_0' has completed task_20131031160444934_0029_m_000002 successfully.
2013-10-31 16:17:36,554 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000003_0' has completed task_20131031160444934_0029_m_000003 successfully.
2013-10-31 16:17:36,627 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000004_0' has completed task_20131031160444934_0029_m_000004 successfully.
2013-10-31 16:17:36,979 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:36,982 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt:4+4
2013-10-31 16:17:36,983 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000001_0 is done.
2013-10-31 16:17:36,983 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000001_0 was -1
2013-10-31 16:17:36,984 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:39,448 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000001_0' has completed task_20131031160444934_0029_m_000001 successfully.
2013-10-31 16:17:39,451 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0029_m_000005_0' to tip task_20131031160444934_0029_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:39,454 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0029_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:17:39,454 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0029_m_000005_0 which needs 1 slots
2013-10-31 16:17:39,455 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0029_m_000005_0 which needs 1 slots
2013-10-31 16:17:39,490 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0029/attempt_20131031160444934_0029_m_000005_0. Attempting to reuse: jvm_20131031160444934_0029_m_-90922477
2013-10-31 16:17:39,847 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:17:39,864 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,875 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,881 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,886 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:17:39,892 INFO metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:17:40,506 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0029_m_-90922477 given task: attempt_20131031160444934_0029_m_000005_0
2013-10-31 16:17:40,612 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000005_0 0.0%
2013-10-31 16:17:40,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_temporary dst=null perm=null
2013-10-31 16:17:40,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:40,629 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_SUCCESS from client DFSClient_attempt_20131031160444934_0029_m_000005_0
2013-10-31 16:17:40,629 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0029_m_000005_0
2013-10-31 16:17:40,635 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,635 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:40,635 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,635 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5546483287794460021 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:40,635 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6818519663719605632 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2835549027426087773 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2835549027426087773 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2835549027426087773 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4320670473446602513 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:40,636 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4320670473446602513 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:40,637 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4320670473446602513 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:17:40,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0029 dst=null perm=null
2013-10-31 16:17:42,327 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-2835549027426087773_1333 blk_-5546483287794460021_1331 blk_6818519663719605632_1332 blk_4320670473446602513_1334
2013-10-31 16:17:42,328 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-2835549027426087773_1333 blk_-5546483287794460021_1331 blk_6818519663719605632_1332
2013-10-31 16:17:42,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data4/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:42,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2835549027426087773_1333 file build/test/data/dfs/data/data3/current/blk_-2835549027426087773 for deletion
2013-10-31 16:17:42,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data4/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:42,483 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2835549027426087773_1333 at file build/test/data/dfs/data/data3/current/blk_-2835549027426087773
2013-10-31 16:17:42,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data4/current/blk_-5546483287794460021
2013-10-31 16:17:42,483 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data4/current/blk_6818519663719605632
2013-10-31 16:17:43,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data5/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:43,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2835549027426087773_1333 file build/test/data/dfs/data/data5/current/blk_-2835549027426087773 for deletion
2013-10-31 16:17:43,096 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data5/current/blk_-5546483287794460021
2013-10-31 16:17:43,096 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4320670473446602513_1334 file build/test/data/dfs/data/data6/current/blk_4320670473446602513 for deletion
2013-10-31 16:17:43,096 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2835549027426087773_1333 at file build/test/data/dfs/data/data5/current/blk_-2835549027426087773
2013-10-31 16:17:43,096 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data6/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:43,096 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4320670473446602513_1334 at file build/test/data/dfs/data/data6/current/blk_4320670473446602513
2013-10-31 16:17:43,097 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data6/current/blk_6818519663719605632
2013-10-31 16:17:43,589 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0029_m_000005_0 0.0% cleanup
2013-10-31 16:17:43,591 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0029_m_000005_0 is done.
2013-10-31 16:17:43,591 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0029_m_000005_0 was -1
2013-10-31 16:17:43,591 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:45,328 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-2835549027426087773_1333 blk_-5546483287794460021_1331 blk_6818519663719605632_1332 blk_4320670473446602513_1334
2013-10-31 16:17:45,328 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5546483287794460021_1331 blk_6818519663719605632_1332 blk_4320670473446602513_1334
2013-10-31 16:17:45,463 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0029_m_000005_0' has completed task_20131031160444934_0029_m_000005 successfully.
2013-10-31 16:17:45,464 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0029 has completed successfully.
2013-10-31 16:17:45,464 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0029,submitTime=1383236239381,launchTime=1383236239905,firstMapTaskLaunchTime=1383236247432,firstJobSetupTaskLaunchTime=1383236241416,firstJobCleanupTaskLaunchTime=1383236259451,finishTime=1383236265464,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=44,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E4EC0E4BA2CD4E49B23EC80C191F27BB/B7FAAC861D56461B99ECD9CA24C0A34C] lower*upper1*upper2/(2/3)
2013-10-31 16:17:45,471 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B. blk_-4844518074889198090_1343
2013-10-31 16:17:45,473 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4844518074889198090_1343 src: /127.0.0.1:49285 dest: /127.0.0.1:47311
2013-10-31 16:17:45,475 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4844518074889198090_1343 src: /127.0.0.1:36253 dest: /127.0.0.1:38271
2013-10-31 16:17:45,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4844518074889198090_1343 src: /127.0.0.1:56290 dest: /127.0.0.1:41648
2013-10-31 16:17:45,487 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56290, dest: /127.0.0.1:41648, bytes: 26357, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4844518074889198090_1343, duration: 4099176
2013-10-31 16:17:45,488 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4844518074889198090_1343 terminating
2013-10-31 16:17:45,488 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36253, dest: /127.0.0.1:38271, bytes: 26357, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4844518074889198090_1343, duration: 5579161
2013-10-31 16:17:45,489 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4844518074889198090_1343 terminating
2013-10-31 16:17:45,489 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49285, dest: /127.0.0.1:47311, bytes: 26357, op: HDFS_WRITE, cliID: DFSClient_-350050235, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4844518074889198090_1343, duration: 6222455
2013-10-31 16:17:45,489 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4844518074889198090_1343 terminating
2013-10-31 16:17:45,496 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4844518074889198090_1343 size 26357
2013-10-31 16:17:45,498 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B from client DFSClient_-350050235
2013-10-31 16:17:45,500 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/_logs/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B is closed by DFSClient_-350050235
2013-10-31 16:17:45,500 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4844518074889198090_1343 size 26357
2013-10-31 16:17:45,501 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4844518074889198090_1343 size 26357
2013-10-31 16:17:45,522 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0029_1383236239381_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2FB7FAAC861D56461B to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:45,523 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000000_0'
2013-10-31 16:17:45,525 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000001_0'
2013-10-31 16:17:45,525 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000005_0'
2013-10-31 16:17:45,525 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000006_0'
2013-10-31 16:17:45,526 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1641886665873571422 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:17:45,527 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1641886665873571422 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:17:45,527 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1641886665873571422 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:17:45,531 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0029_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:17:45,531 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] starting step: (1/3) ...rm/joinsamesourceintojoin
2013-10-31 16:17:45,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0029 dst=null perm=null
2013-10-31 16:17:45,537 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:17:45,537 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:17:45,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:45,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:17:45,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,563 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar. blk_-8492324455653831791_1344
2013-10-31 16:17:45,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:36256 dest: /127.0.0.1:38271
2013-10-31 16:17:45,565 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000002_0'
2013-10-31 16:17:45,566 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000003_0'
2013-10-31 16:17:45,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:49290 dest: /127.0.0.1:47311
2013-10-31 16:17:45,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:56294 dest: /127.0.0.1:41648
2013-10-31 16:17:45,575 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56294, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8492324455653831791_1344, duration: 3803381
2013-10-31 16:17:45,576 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8492324455653831791_1344 terminating
2013-10-31 16:17:45,576 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49290, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8492324455653831791_1344, duration: 3992986
2013-10-31 16:17:45,577 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8492324455653831791_1344 terminating
2013-10-31 16:17:45,577 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36256, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8492324455653831791_1344, duration: 5776421
2013-10-31 16:17:45,578 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8492324455653831791_1344 terminating
2013-10-31 16:17:45,580 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:45,580 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar from client DFSClient_1457307213
2013-10-31 16:17:45,580 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar is closed by DFSClient_1457307213
2013-10-31 16:17:45,581 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:45,582 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:45,587 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar. New replication is 10
2013-10-31 16:17:45,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar dst=null perm=null
2013-10-31 16:17:45,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,601 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:17:45,605 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:17:45,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:17:45,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,621 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split. New replication is 10
2013-10-31 16:17:45,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=null
2013-10-31 16:17:45,628 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split. blk_1824606275897357057_1345
2013-10-31 16:17:45,630 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:56295 dest: /127.0.0.1:41648
2013-10-31 16:17:45,632 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:36260 dest: /127.0.0.1:38271
2013-10-31 16:17:45,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:36192 dest: /127.0.0.1:50942
2013-10-31 16:17:45,635 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1824606275897357057_1345 src: /127.0.0.1:49295 dest: /127.0.0.1:47311
2013-10-31 16:17:45,638 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0029_m_000004_0'
2013-10-31 16:17:45,639 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:45,640 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0029 being deleted.
2013-10-31 16:17:45,640 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49295, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1824606275897357057_1345, duration: 2554126
2013-10-31 16:17:45,640 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,640 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,641 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36192, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1824606275897357057_1345, duration: 3103212
2013-10-31 16:17:45,642 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,642 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36260, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1824606275897357057_1345, duration: 2076649
2013-10-31 16:17:45,643 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,643 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,643 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56295, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1824606275897357057_1345, duration: 3174618
2013-10-31 16:17:45,644 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1824606275897357057_1345 terminating
2013-10-31 16:17:45,645 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,646 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split from client DFSClient_1457307213
2013-10-31 16:17:45,646 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split is closed by DFSClient_1457307213
2013-10-31 16:17:45,648 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1824606275897357057_1345 size 1732
2013-10-31 16:17:45,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,664 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo. blk_-6914640943678526682_1346
2013-10-31 16:17:45,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6914640943678526682_1346 src: /127.0.0.1:56299 dest: /127.0.0.1:41648
2013-10-31 16:17:45,668 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6914640943678526682_1346 src: /127.0.0.1:36195 dest: /127.0.0.1:50942
2013-10-31 16:17:45,669 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6914640943678526682_1346 src: /127.0.0.1:36265 dest: /127.0.0.1:38271
2013-10-31 16:17:45,674 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36265, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6914640943678526682_1346, duration: 67957
2013-10-31 16:17:45,675 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6914640943678526682_1346 terminating
2013-10-31 16:17:45,676 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6914640943678526682_1346 size 183
2013-10-31 16:17:45,676 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36195, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6914640943678526682_1346, duration: 2052177
2013-10-31 16:17:45,678 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6914640943678526682_1346 terminating
2013-10-31 16:17:45,678 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56299, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6914640943678526682_1346, duration: 3803721
2013-10-31 16:17:45,679 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6914640943678526682_1346 size 183
2013-10-31 16:17:45,679 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6914640943678526682_1346 terminating
2013-10-31 16:17:45,681 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6914640943678526682_1346 size 183
2013-10-31 16:17:45,681 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:17:45,682 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:17:45,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:45,716 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml. blk_-8878127457679220121_1347
2013-10-31 16:17:45,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8878127457679220121_1347 src: /127.0.0.1:56302 dest: /127.0.0.1:41648
2013-10-31 16:17:45,719 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8878127457679220121_1347 src: /127.0.0.1:36198 dest: /127.0.0.1:50942
2013-10-31 16:17:45,720 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8878127457679220121_1347 src: /127.0.0.1:36268 dest: /127.0.0.1:38271
2013-10-31 16:17:45,723 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36268, dest: /127.0.0.1:38271, bytes: 28707, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 66309
2013-10-31 16:17:45,724 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8878127457679220121_1347 terminating
2013-10-31 16:17:45,724 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8878127457679220121_1347 size 28707
2013-10-31 16:17:45,724 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36198, dest: /127.0.0.1:50942, bytes: 28707, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8878127457679220121_1347, duration: 827134
2013-10-31 16:17:45,725 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8878127457679220121_1347 terminating
2013-10-31 16:17:45,725 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56302, dest: /127.0.0.1:41648, bytes: 28707, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8878127457679220121_1347, duration: 1827844
2013-10-31 16:17:45,725 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8878127457679220121_1347 terminating
2013-10-31 16:17:45,729 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8878127457679220121_1347 size 28707
2013-10-31 16:17:45,729 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml from client DFSClient_1457307213
2013-10-31 16:17:45,730 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml is closed by DFSClient_1457307213
2013-10-31 16:17:45,730 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8878127457679220121_1347 size 28707
2013-10-31 16:17:45,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml dst=null perm=null
2013-10-31 16:17:45,749 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56306, bytes: 28935, op: HDFS_READ, cliID: DFSClient_695084204, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8878127457679220121_1347, duration: 398556
2013-10-31 16:17:45,766 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0030: nMaps=5 nReduces=0 max=-1
2013-10-31 16:17:45,767 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0030 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:17:45,767 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0030 RESULT=SUCCESS
2013-10-31 16:17:45,767 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0030
2013-10-31 16:17:45,767 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0030
2013-10-31 16:17:45,767 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper1*upper2] submitted hadoop job: job_20131031160444934_0030
2013-10-31 16:17:47,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:47,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:47,276 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml. blk_820581296167968970_1349
2013-10-31 16:17:47,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_820581296167968970_1349 src: /127.0.0.1:36202 dest: /127.0.0.1:50942
2013-10-31 16:17:47,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_820581296167968970_1349 src: /127.0.0.1:56308 dest: /127.0.0.1:41648
2013-10-31 16:17:47,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_820581296167968970_1349 src: /127.0.0.1:36273 dest: /127.0.0.1:38271
2013-10-31 16:17:47,282 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36273, dest: /127.0.0.1:38271, bytes: 28772, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_820581296167968970_1349, duration: 96870
2013-10-31 16:17:47,282 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_820581296167968970_1349 size 28772
2013-10-31 16:17:47,282 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_820581296167968970_1349 terminating
2013-10-31 16:17:47,283 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56308, dest: /127.0.0.1:41648, bytes: 28772, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_820581296167968970_1349, duration: 1009409
2013-10-31 16:17:47,284 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_820581296167968970_1349 terminating
2013-10-31 16:17:47,284 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36202, dest: /127.0.0.1:50942, bytes: 28772, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_820581296167968970_1349, duration: 2555957
2013-10-31 16:17:47,284 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_820581296167968970_1349 terminating
2013-10-31 16:17:47,287 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_820581296167968970_1349 size 28772
2013-10-31 16:17:47,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_820581296167968970_1349 size 28772
2013-10-31 16:17:47,291 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml from client DFSClient_695084204
2013-10-31 16:17:47,291 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_conf.xml is closed by DFSClient_695084204
2013-10-31 16:17:47,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:47,305 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken. blk_-5985565395941547146_1350
2013-10-31 16:17:47,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5985565395941547146_1350 src: /127.0.0.1:36205 dest: /127.0.0.1:50942
2013-10-31 16:17:47,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5985565395941547146_1350 src: /127.0.0.1:49308 dest: /127.0.0.1:47311
2013-10-31 16:17:47,310 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5985565395941547146_1350 src: /127.0.0.1:36276 dest: /127.0.0.1:38271
2013-10-31 16:17:47,313 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36276, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5985565395941547146_1350, duration: 67632
2013-10-31 16:17:47,313 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5985565395941547146_1350 terminating
2013-10-31 16:17:47,313 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49308, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5985565395941547146_1350, duration: 834445
2013-10-31 16:17:47,314 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5985565395941547146_1350 terminating
2013-10-31 16:17:47,314 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36205, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5985565395941547146_1350, duration: 1625507
2013-10-31 16:17:47,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5985565395941547146_1350 size 116
2013-10-31 16:17:47,315 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5985565395941547146_1350 terminating
2013-10-31 16:17:47,317 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5985565395941547146_1350 size 116
2013-10-31 16:17:47,318 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken from client DFSClient_1457307213
2013-10-31 16:17:47,318 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken is closed by DFSClient_1457307213
2013-10-31 16:17:47,318 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5985565395941547146_1350 size 116
2013-10-31 16:17:47,324 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken
2013-10-31 16:17:47,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.splitmetainfo dst=null perm=null
2013-10-31 16:17:47,328 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36277, bytes: 187, op: HDFS_READ, cliID: DFSClient_695084204, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6914640943678526682_1346, duration: 275800
2013-10-31 16:17:47,329 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0030 = 19. Number of splits = 5
2013-10-31 16:17:47,330 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,330 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,330 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,330 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,331 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,333 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,333 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:17:47,333 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0030 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:17:47,334 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0030 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:17:47,884 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data2/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:47,884 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4320670473446602513_1334 file build/test/data/dfs/data/data2/current/blk_4320670473446602513 for deletion
2013-10-31 16:17:47,884 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data2/current/blk_-5546483287794460021
2013-10-31 16:17:47,884 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data1/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:47,885 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4320670473446602513_1334 at file build/test/data/dfs/data/data2/current/blk_4320670473446602513
2013-10-31 16:17:47,885 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data1/current/blk_6818519663719605632
2013-10-31 16:17:48,094 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5546483287794460021_1331 file build/test/data/dfs/data/data7/current/blk_-5546483287794460021 for deletion
2013-10-31 16:17:48,094 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2835549027426087773_1333 file build/test/data/dfs/data/data7/current/blk_-2835549027426087773 for deletion
2013-10-31 16:17:48,094 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4320670473446602513_1334 file build/test/data/dfs/data/data8/current/blk_4320670473446602513 for deletion
2013-10-31 16:17:48,094 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5546483287794460021_1331 at file build/test/data/dfs/data/data7/current/blk_-5546483287794460021
2013-10-31 16:17:48,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4320670473446602513_1334 at file build/test/data/dfs/data/data8/current/blk_4320670473446602513
2013-10-31 16:17:48,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2835549027426087773_1333 at file build/test/data/dfs/data/data7/current/blk_-2835549027426087773
2013-10-31 16:17:48,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6818519663719605632_1332 file build/test/data/dfs/data/data8/current/blk_6818519663719605632 for deletion
2013-10-31 16:17:48,096 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6818519663719605632_1332 at file build/test/data/dfs/data/data8/current/blk_6818519663719605632
2013-10-31 16:17:48,329 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-8492324455653831791_1344 to datanode(s) 127.0.0.1:50942
2013-10-31 16:17:48,330 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-1641886665873571422_1337
2013-10-31 16:17:48,330 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-1641886665873571422_1337
2013-10-31 16:17:48,484 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1641886665873571422_1337 file build/test/data/dfs/data/data3/current/blk_-1641886665873571422 for deletion
2013-10-31 16:17:48,484 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1641886665873571422_1337 at file build/test/data/dfs/data/data3/current/blk_-1641886665873571422
2013-10-31 16:17:48,531 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0030_m_000006_0' to tip task_20131031160444934_0030_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:48,537 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:17:48,538 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000006_0 which needs 1 slots
2013-10-31 16:17:48,538 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000006_0 which needs 1 slots
2013-10-31 16:17:48,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken dst=null perm=null
2013-10-31 16:17:48,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36278, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5985565395941547146_1350, duration: 346507
2013-10-31 16:17:48,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml dst=null perm=null
2013-10-31 16:17:48,557 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36280, bytes: 28935, op: HDFS_READ, cliID: DFSClient_-1661306941, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 370631
2013-10-31 16:17:48,591 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:48,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar dst=null perm=null
2013-10-31 16:17:48,618 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49314, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1661306941, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8492324455653831791_1344, duration: 1307872
2013-10-31 16:17:48,728 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0029_m_-1440454458
2013-10-31 16:17:48,734 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28199 with signal TERM. Exit code 0
2013-10-31 16:17:48,734 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_407080348
2013-10-31 16:17:48,735 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_407080348 spawned.
2013-10-31 16:17:48,736 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000006_0/taskjvm.sh
2013-10-31 16:17:48,833 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0029_m_-1440454458
2013-10-31 16:17:49,447 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:49,447 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:49,447 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:49,448 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1440454458 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:50,167 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_407080348 given task: attempt_20131031160444934_0030_m_000006_0
2013-10-31 16:17:50,527 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:50,527 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000005_0 not found in cache
2013-10-31 16:17:50,527 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000001_0 not found in cache
2013-10-31 16:17:50,527 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000000_0 not found in cache
2013-10-31 16:17:50,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0029 for user-log deletion with retainTimeStamp:1383322670528
2013-10-31 16:17:50,566 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:50,567 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000003_0 not found in cache
2013-10-31 16:17:50,567 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000002_0 not found in cache
2013-10-31 16:17:50,567 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0029 for user-log deletion with retainTimeStamp:1383322670567
2013-10-31 16:17:50,639 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0029
2013-10-31 16:17:50,639 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0029_m_000004_0 not found in cache
2013-10-31 16:17:50,639 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0029 for user-log deletion with retainTimeStamp:1383322670639
2013-10-31 16:17:50,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:50,757 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-1171757031 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:50,767 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28381 with signal TERM. Exit code 0
2013-10-31 16:17:50,885 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-8492324455653831791_1344 to 127.0.0.1:50942
2013-10-31 16:17:50,886 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1641886665873571422_1337 file build/test/data/dfs/data/data1/current/blk_-1641886665873571422 for deletion
2013-10-31 16:17:50,886 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1641886665873571422_1337 at file build/test/data/dfs/data/data1/current/blk_-1641886665873571422
2013-10-31 16:17:50,887 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8492324455653831791_1344 src: /127.0.0.1:36215 dest: /127.0.0.1:50942
2013-10-31 16:17:50,887 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-8492324455653831791_1344 to /127.0.0.1:50942
2013-10-31 16:17:50,891 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8492324455653831791_1344 src: /127.0.0.1:36215 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:17:50,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8492324455653831791_1344 size 238055
2013-10-31 16:17:50,951 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:50,951 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:50,951 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:50,951 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1171757031 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:51,331 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-1641886665873571422_1337
2013-10-31 16:17:51,509 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-1587966514 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:51,520 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28300 with signal TERM. Exit code 0
2013-10-31 16:17:51,631 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-90922477 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:51,642 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28062 with signal TERM. Exit code 0
2013-10-31 16:17:51,697 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:51,697 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:51,697 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:51,697 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1587966514 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:51,718 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0029_m_-1214579449 since job job_20131031160444934_0029 is dead
2013-10-31 16:17:51,723 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28346 with signal TERM. Exit code 0
2013-10-31 16:17:51,807 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:51,808 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:51,808 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:51,808 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-90922477 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:17:51,908 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:17:51,908 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:17:51,908 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:17:51,908 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0029_m_-1214579449 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:17:52,097 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1641886665873571422_1337 file build/test/data/dfs/data/data6/current/blk_-1641886665873571422 for deletion
2013-10-31 16:17:52,098 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1641886665873571422_1337 at file build/test/data/dfs/data/data6/current/blk_-1641886665873571422
2013-10-31 16:17:53,608 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000006_0 0.0% setup
2013-10-31 16:17:53,611 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000006_0 is done.
2013-10-31 16:17:53,611 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000006_0 was -1
2013-10-31 16:17:53,612 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:54,545 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000006_0' has completed task_20131031160444934_0030_m_000006 successfully.
2013-10-31 16:17:54,700 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000000_0' to tip task_20131031160444934_0030_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:54,702 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000000
2013-10-31 16:17:54,702 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000001_0' to tip task_20131031160444934_0030_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:17:54,703 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000001
2013-10-31 16:17:54,704 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000002_0' to tip task_20131031160444934_0030_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:17:54,706 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:17:54,706 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000002
2013-10-31 16:17:54,707 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:17:54,707 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000003_0' to tip task_20131031160444934_0030_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:17:54,707 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000000_0 which needs 1 slots
2013-10-31 16:17:54,707 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000000_0 which needs 1 slots
2013-10-31 16:17:54,707 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000003
2013-10-31 16:17:54,708 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000001_0 which needs 1 slots
2013-10-31 16:17:54,708 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0030_m_000001_0 which needs 1 slots
2013-10-31 16:17:54,710 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0030_m_000004_0' to tip task_20131031160444934_0030_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:17:54,710 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0030_m_000004
2013-10-31 16:17:54,712 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:17:54,714 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:17:54,718 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:17:54,718 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000002_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000004_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000002_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000004_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000003_0 which needs 1 slots
2013-10-31 16:17:54,719 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0030_m_000003_0 which needs 1 slots
2013-10-31 16:17:54,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken dst=null perm=null
2013-10-31 16:17:54,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030/jobToken dst=null perm=null
2013-10-31 16:17:54,843 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_357915176
2013-10-31 16:17:54,845 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_357915176 spawned.
2013-10-31 16:17:54,846 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0030/attempt_20131031160444934_0030_m_000001_0. Attempting to reuse: jvm_20131031160444934_0030_m_407080348
2013-10-31 16:17:54,847 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49319, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5985565395941547146_1350, duration: 1166246
2013-10-31 16:17:54,849 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000000_0/taskjvm.sh
2013-10-31 16:17:54,849 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49320, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5985565395941547146_1350, duration: 273662
2013-10-31 16:17:54,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml dst=null perm=null
2013-10-31 16:17:54,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.xml dst=null perm=null
2013-10-31 16:17:54,860 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36290, bytes: 28935, op: HDFS_READ, cliID: DFSClient_-1195420231, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 401068
2013-10-31 16:17:54,860 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36291, bytes: 28935, op: HDFS_READ, cliID: DFSClient_-517762114, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8878127457679220121_1347, duration: 443510
2013-10-31 16:17:54,888 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:54,892 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:17:54,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar dst=null perm=null
2013-10-31 16:17:54,906 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56328, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1195420231, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8492324455653831791_1344, duration: 618319
2013-10-31 16:17:54,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.jar dst=null perm=null
2013-10-31 16:17:54,916 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36293, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-517762114, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8492324455653831791_1344, duration: 619822
2013-10-31 16:17:54,962 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_767723640
2013-10-31 16:17:54,963 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_767723640 spawned.
2013-10-31 16:17:54,964 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000002_0/taskjvm.sh
2013-10-31 16:17:54,965 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_1871656188
2013-10-31 16:17:54,966 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_1871656188 spawned.
2013-10-31 16:17:54,968 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000003_0/taskjvm.sh
2013-10-31 16:17:54,974 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_-469071112
2013-10-31 16:17:54,974 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_-469071112 spawned.
2013-10-31 16:17:54,976 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000004_0/taskjvm.sh
2013-10-31 16:17:55,174 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_407080348 given task: attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:55,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=null
2013-10-31 16:17:55,283 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56331, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1824606275897357057_1345, duration: 167727
2013-10-31 16:17:55,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:17:55,327 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49329, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 291181
2013-10-31 16:17:55,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:55,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:55,669 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_357915176 given task: attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:55,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=null
2013-10-31 16:17:55,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:55,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:55,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:55,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:55,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:55,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:55,876 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56334, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1663768746748666765_1339, duration: 129942
2013-10-31 16:17:55,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:55,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56335, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7018752213662655129_1339, duration: 131934
2013-10-31 16:17:55,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:55,896 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36231, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4668368595109805817_1342, duration: 97867
2013-10-31 16:17:55,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:55,900 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36301, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6018207326177541389_1341, duration: 124272
2013-10-31 16:17:55,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:55,903 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36233, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 111321
2013-10-31 16:17:55,912 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001. blk_-167795708726022168_1351
2013-10-31 16:17:55,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-167795708726022168_1351 src: /127.0.0.1:49336 dest: /127.0.0.1:47311
2013-10-31 16:17:55,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-167795708726022168_1351 src: /127.0.0.1:56340 dest: /127.0.0.1:41648
2013-10-31 16:17:55,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-167795708726022168_1351 src: /127.0.0.1:36305 dest: /127.0.0.1:38271
2013-10-31 16:17:55,933 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36305, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-167795708726022168_1351, duration: 1633305
2013-10-31 16:17:55,933 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-167795708726022168_1351 terminating
2013-10-31 16:17:55,933 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56340, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-167795708726022168_1351, duration: 454847
2013-10-31 16:17:55,933 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-167795708726022168_1351 terminating
2013-10-31 16:17:55,933 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49336, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-167795708726022168_1351, duration: 780365
2013-10-31 16:17:55,933 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-167795708726022168_1351 terminating
2013-10-31 16:17:55,934 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-167795708726022168_1351 size 12
2013-10-31 16:17:55,935 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-167795708726022168_1351 size 12
2013-10-31 16:17:55,935 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-167795708726022168_1351 size 12
2013-10-31 16:17:55,935 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:55,936 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:55,975 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:55,975 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000001_0 0.0%
2013-10-31 16:17:56,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=null
2013-10-31 16:17:56,197 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36238, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1824606275897357057_1345, duration: 169417
2013-10-31 16:17:56,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:17:56,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:56,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:56,432 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_767723640 given task: attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:56,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=null
2013-10-31 16:17:56,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:56,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:56,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:56,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:56,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:56,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:56,482 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49344, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 135391
2013-10-31 16:17:56,489 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_1871656188 given task: attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:17:56,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:56,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49345, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7018752213662655129_1339, duration: 124593
2013-10-31 16:17:56,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:56,502 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56349, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 100064
2013-10-31 16:17:56,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:56,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49347, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6018207326177541389_1341, duration: 103426
2013-10-31 16:17:56,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:56,508 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36315, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1513594355081957583_1342, duration: 99842
2013-10-31 16:17:56,511 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49349, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 99964
2013-10-31 16:17:56,518 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000. blk_-1312997292511735196_1352
2013-10-31 16:17:56,545 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1312997292511735196_1352 src: /127.0.0.1:49350 dest: /127.0.0.1:47311
2013-10-31 16:17:56,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1312997292511735196_1352 src: /127.0.0.1:56354 dest: /127.0.0.1:41648
2013-10-31 16:17:56,547 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1312997292511735196_1352 src: /127.0.0.1:36250 dest: /127.0.0.1:50942
2013-10-31 16:17:56,549 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36250, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1312997292511735196_1352, duration: 1152477
2013-10-31 16:17:56,550 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1312997292511735196_1352 terminating
2013-10-31 16:17:56,550 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56354, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1312997292511735196_1352, duration: 1486022
2013-10-31 16:17:56,550 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1312997292511735196_1352 terminating
2013-10-31 16:17:56,550 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49350, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1312997292511735196_1352, duration: 1848691
2013-10-31 16:17:56,550 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1312997292511735196_1352 terminating
2013-10-31 16:17:56,551 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_-469071112 given task: attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:17:56,553 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1312997292511735196_1352 size 12
2013-10-31 16:17:56,554 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1312997292511735196_1352 size 12
2013-10-31 16:17:56,554 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1312997292511735196_1352 size 12
2013-10-31 16:17:56,904 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-167795708726022168_1351
2013-10-31 16:17:56,952 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:56,953 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:56,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=null
2013-10-31 16:17:56,964 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36253, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1824606275897357057_1345, duration: 162664
2013-10-31 16:17:56,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=null
2013-10-31 16:17:57,002 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36324, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1824606275897357057_1345, duration: 247582
2013-10-31 16:17:57,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:17:57,005 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,005 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000000_0 0.0%
2013-10-31 16:17:57,007 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36256, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 196274
2013-10-31 16:17:57,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:57,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:17:57,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49359, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 121610
2013-10-31 16:17:57,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030/job.split dst=null perm=null
2013-10-31 16:17:57,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56363, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1824606275897357057_1345, duration: 150417
2013-10-31 16:17:57,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:17:57,115 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36259, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 137314
2013-10-31 16:17:57,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=null
2013-10-31 16:17:57,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:57,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:57,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:57,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:57,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:57,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:57,374 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49362, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 287311
2013-10-31 16:17:57,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:57,391 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36330, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7018752213662655129_1339, duration: 125286
2013-10-31 16:17:57,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:57,394 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56367, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 103694
2013-10-31 16:17:57,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:57,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:57,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36332, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6018207326177541389_1341, duration: 101225
2013-10-31 16:17:57,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:57,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:57,401 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36264, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 266254
2013-10-31 16:17:57,411 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002. blk_669744094790171250_1355
2013-10-31 16:17:57,441 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_669744094790171250_1355 src: /127.0.0.1:36265 dest: /127.0.0.1:50942
2013-10-31 16:17:57,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_669744094790171250_1355 src: /127.0.0.1:56371 dest: /127.0.0.1:41648
2013-10-31 16:17:57,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_669744094790171250_1355 src: /127.0.0.1:49369 dest: /127.0.0.1:47311
2013-10-31 16:17:57,444 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49369, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_669744094790171250_1355, duration: 1058907
2013-10-31 16:17:57,445 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_669744094790171250_1355 terminating
2013-10-31 16:17:57,445 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_669744094790171250_1355 size 12
2013-10-31 16:17:57,445 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56371, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_669744094790171250_1355, duration: 1422366
2013-10-31 16:17:57,445 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_669744094790171250_1355 terminating
2013-10-31 16:17:57,445 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36265, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_669744094790171250_1355, duration: 1924515
2013-10-31 16:17:57,446 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_669744094790171250_1355 terminating
2013-10-31 16:17:57,446 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:57,447 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:57,447 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_669744094790171250_1355 size 12
2013-10-31 16:17:57,449 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_669744094790171250_1355 size 12
2013-10-31 16:17:57,493 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,493 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000002_0 0.0%
2013-10-31 16:17:57,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=null
2013-10-31 16:17:57,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:57,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:57,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:57,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:57,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:57,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:57,623 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56373, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1663768746748666765_1339, duration: 160292
2013-10-31 16:17:57,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=null
2013-10-31 16:17:57,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:57,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:57,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:57,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:57,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:57,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:57,640 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36338, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7018752213662655129_1339, duration: 105310
2013-10-31 16:17:57,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:57,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00000 dst=null perm=null
2013-10-31 16:17:57,644 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56375, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 101836
2013-10-31 16:17:57,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:57,647 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49373, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6018207326177541389_1341, duration: 109569
2013-10-31 16:17:57,648 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49374, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1663768746748666765_1339, duration: 117370
2013-10-31 16:17:57,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:57,651 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36273, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1513594355081957583_1342, duration: 103499
2013-10-31 16:17:57,659 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004. blk_7061817477599287647_1355
2013-10-31 16:17:57,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00001 dst=null perm=null
2013-10-31 16:17:57,666 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49377, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7018752213662655129_1339, duration: 116217
2013-10-31 16:17:57,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00002 dst=null perm=null
2013-10-31 16:17:57,669 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56381, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4668368595109805817_1342, duration: 114922
2013-10-31 16:17:57,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00003 dst=null perm=null
2013-10-31 16:17:57,672 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36277, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6018207326177541389_1341, duration: 114866
2013-10-31 16:17:57,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68/part-00004 dst=null perm=null
2013-10-31 16:17:57,675 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36347, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1513594355081957583_1342, duration: 115849
2013-10-31 16:17:57,682 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7061817477599287647_1355 src: /127.0.0.1:49376 dest: /127.0.0.1:47311
2013-10-31 16:17:57,683 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7061817477599287647_1355 src: /127.0.0.1:36348 dest: /127.0.0.1:38271
2013-10-31 16:17:57,684 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7061817477599287647_1355 src: /127.0.0.1:36280 dest: /127.0.0.1:50942
2013-10-31 16:17:57,686 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003. blk_3963998881078876696_1355
2013-10-31 16:17:57,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36280, dest: /127.0.0.1:50942, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7061817477599287647_1355, duration: 2014793
2013-10-31 16:17:57,689 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7061817477599287647_1355 terminating
2013-10-31 16:17:57,689 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36348, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7061817477599287647_1355, duration: 3595218
2013-10-31 16:17:57,691 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7061817477599287647_1355 terminating
2013-10-31 16:17:57,692 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49376, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7061817477599287647_1355, duration: 5744391
2013-10-31 16:17:57,692 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7061817477599287647_1355 terminating
2013-10-31 16:17:57,692 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7061817477599287647_1355 size 12
2013-10-31 16:17:57,693 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:17:57,694 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:17:57,694 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7061817477599287647_1355 size 12
2013-10-31 16:17:57,695 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7061817477599287647_1355 size 12
2013-10-31 16:17:57,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3963998881078876696_1355 src: /127.0.0.1:36350 dest: /127.0.0.1:38271
2013-10-31 16:17:57,710 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3963998881078876696_1355 src: /127.0.0.1:56387 dest: /127.0.0.1:41648
2013-10-31 16:17:57,710 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000000_0
2013-10-31 16:17:57,710 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000001_0
2013-10-31 16:17:57,711 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3963998881078876696_1355 src: /127.0.0.1:49385 dest: /127.0.0.1:47311
2013-10-31 16:17:57,713 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000002_0
2013-10-31 16:17:57,713 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49385, dest: /127.0.0.1:47311, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3963998881078876696_1355, duration: 855662
2013-10-31 16:17:57,714 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3963998881078876696_1355 terminating
2013-10-31 16:17:57,714 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56387, dest: /127.0.0.1:41648, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3963998881078876696_1355, duration: 1624032
2013-10-31 16:17:57,715 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3963998881078876696_1355 size 12
2013-10-31 16:17:57,715 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3963998881078876696_1355 terminating
2013-10-31 16:17:57,715 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36350, dest: /127.0.0.1:38271, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0030_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3963998881078876696_1355, duration: 2713840
2013-10-31 16:17:57,716 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3963998881078876696_1355 size 12
2013-10-31 16:17:57,716 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3963998881078876696_1355 terminating
2013-10-31 16:17:57,717 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:17:57,718 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:17:57,718 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3963998881078876696_1355 size 12
2013-10-31 16:17:57,758 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,758 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000004_0 0.0%
2013-10-31 16:17:57,765 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0030_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:17:57,766 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000003_0 0.0%
2013-10-31 16:17:57,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0 dst=null perm=null
2013-10-31 16:17:57,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:57,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:58,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000001_0 dst=null perm=null
2013-10-31 16:17:58,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0 dst=null perm=null
2013-10-31 16:17:58,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:58,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:58,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000000_0 dst=null perm=null
2013-10-31 16:17:58,243 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:17:58,245 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000001_0 is done.
2013-10-31 16:17:58,245 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000001_0 was -1
2013-10-31 16:17:58,246 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:17:58,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0 dst=null perm=null
2013-10-31 16:17:58,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:17:58,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:17:58,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000002_0 dst=null perm=null
2013-10-31 16:17:59,123 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:17:59,125 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000000_0 is done.
2013-10-31 16:17:59,125 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000000_0 was -1
2013-10-31 16:17:59,125 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:17:59,707 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0030_m_000006_0
2013-10-31 16:17:59,708 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0030_m_000006_0
2013-10-31 16:17:59,708 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000006_0 not found in cache
2013-10-31 16:17:59,885 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:17:59,887 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000002_0 is done.
2013-10-31 16:17:59,887 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000002_0 was -1
2013-10-31 16:17:59,888 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:00,716 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000000_0' has completed task_20131031160444934_0030_m_000000 successfully.
2013-10-31 16:18:00,717 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000001_0' has completed task_20131031160444934_0030_m_000001 successfully.
2013-10-31 16:18:00,720 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000002_0' has completed task_20131031160444934_0030_m_000002 successfully.
2013-10-31 16:18:00,722 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000003_0
2013-10-31 16:18:00,723 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0030_m_000004_0
2013-10-31 16:18:00,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0 dst=null perm=null
2013-10-31 16:18:00,770 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1895 Total time for transactions(ms): 41Number of transactions batched in Syncs: 211 Number of syncs: 1357 SyncTimes(ms): 63303 13233
2013-10-31 16:18:00,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:00,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0 dst=null perm=null
2013-10-31 16:18:00,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:00,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:00,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000004_0 dst=null perm=null
2013-10-31 16:18:01,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:01,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/_attempt_20131031160444934_0030_m_000003_0 dst=null perm=null
2013-10-31 16:18:02,999 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:18:03,007 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:18:03,008 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000003_0 is done.
2013-10-31 16:18:03,008 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000003_0 was -1
2013-10-31 16:18:03,008 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:03,034 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:18:03,040 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:18:03,041 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000004_0 is done.
2013-10-31 16:18:03,041 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000004_0 was -1
2013-10-31 16:18:03,041 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:03,726 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000003_0' has completed task_20131031160444934_0030_m_000003 successfully.
2013-10-31 16:18:03,728 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000004_0' has completed task_20131031160444934_0030_m_000004 successfully.
2013-10-31 16:18:03,731 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0030_m_000005_0' to tip task_20131031160444934_0030_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:18:03,733 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0030_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:18:03,734 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0030_m_000005_0 which needs 1 slots
2013-10-31 16:18:03,734 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0030_m_000005_0 which needs 1 slots
2013-10-31 16:18:03,767 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0030_m_-1035919601
2013-10-31 16:18:03,768 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0030_m_-1035919601 spawned.
2013-10-31 16:18:03,769 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0030/attempt_20131031160444934_0030_m_000005_0/taskjvm.sh
2013-10-31 16:18:04,799 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0030_m_-1035919601 given task: attempt_20131031160444934_0030_m_000005_0
2013-10-31 16:18:05,315 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000005_0 0.0%
2013-10-31 16:18:05,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary dst=null perm=null
2013-10-31 16:18:05,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:05,344 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS from client DFSClient_attempt_20131031160444934_0030_m_000005_0
2013-10-31 16:18:05,344 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0030_m_000005_0
2013-10-31 16:18:05,352 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,352 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:05,352 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8492324455653831791 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:05,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1824606275897357057 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,353 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6914640943678526682 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,354 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6914640943678526682 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,354 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6914640943678526682 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,354 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8878127457679220121 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:05,354 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8878127457679220121 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:05,354 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8878127457679220121 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:05,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0030 dst=null perm=null
2013-10-31 16:18:05,457 INFO mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031160444934_0030_m_000005_0 is 1726 ms debug.
2013-10-31 16:18:06,333 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8878127457679220121_1347 blk_-6914640943678526682_1346 blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:06,334 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-8878127457679220121_1347 blk_-6914640943678526682_1346 blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:07,103 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8878127457679220121_1347 file build/test/data/dfs/data/data6/current/blk_-8878127457679220121 for deletion
2013-10-31 16:18:07,103 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data5/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:07,103 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8878127457679220121_1347 at file build/test/data/dfs/data/data6/current/blk_-8878127457679220121
2013-10-31 16:18:07,103 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6914640943678526682_1346 file build/test/data/dfs/data/data5/current/blk_-6914640943678526682 for deletion
2013-10-31 16:18:07,104 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data5/current/blk_-8492324455653831791
2013-10-31 16:18:07,104 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data6/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:07,104 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6914640943678526682_1346 at file build/test/data/dfs/data/data5/current/blk_-6914640943678526682
2013-10-31 16:18:07,105 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data6/current/blk_1824606275897357057
2013-10-31 16:18:08,225 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0030_m_000005_0 0.0% cleanup
2013-10-31 16:18:08,227 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0030_m_000005_0 is done.
2013-10-31 16:18:08,227 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0030_m_000005_0 was -1
2013-10-31 16:18:08,228 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:09,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8878127457679220121_1347 file build/test/data/dfs/data/data8/current/blk_-8878127457679220121 for deletion
2013-10-31 16:18:09,101 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data7/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:09,102 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6914640943678526682_1346 file build/test/data/dfs/data/data7/current/blk_-6914640943678526682 for deletion
2013-10-31 16:18:09,102 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data8/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:09,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8878127457679220121_1347 at file build/test/data/dfs/data/data8/current/blk_-8878127457679220121
2013-10-31 16:18:09,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data8/current/blk_1824606275897357057
2013-10-31 16:18:09,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data7/current/blk_-8492324455653831791
2013-10-31 16:18:09,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6914640943678526682_1346 at file build/test/data/dfs/data/data7/current/blk_-6914640943678526682
2013-10-31 16:18:09,334 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:09,335 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-8878127457679220121_1347 blk_-6914640943678526682_1346 blk_-8492324455653831791_1344 blk_1824606275897357057_1345
2013-10-31 16:18:09,490 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data3/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:09,491 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data4/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:09,491 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data4/current/blk_1824606275897357057
2013-10-31 16:18:09,491 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data3/current/blk_-8492324455653831791
2013-10-31 16:18:09,741 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0030_m_000005_0' has completed task_20131031160444934_0030_m_000005 successfully.
2013-10-31 16:18:09,742 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0030 has completed successfully.
2013-10-31 16:18:09,742 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0030,submitTime=1383236265737,launchTime=1383236267333,firstMapTaskLaunchTime=1383236274700,firstJobSetupTaskLaunchTime=1383236268531,firstJobCleanupTaskLaunchTime=1383236283731,finishTime=1383236289742,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E4EC0E4BA2CD4E49B23EC80C191F27BB/4AD809DC610A4252ACDCE6246E6419AA] lower*upper1*upper2/(1/3) ...rm/joinsamesourceintojoin
2013-10-31 16:18:09,747 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252. blk_-2846812765736743198_1356
2013-10-31 16:18:09,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2846812765736743198_1356 src: /127.0.0.1:49390 dest: /127.0.0.1:47311
2013-10-31 16:18:09,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2846812765736743198_1356 src: /127.0.0.1:36358 dest: /127.0.0.1:38271
2013-10-31 16:18:09,757 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2846812765736743198_1356 src: /127.0.0.1:36290 dest: /127.0.0.1:50942
2013-10-31 16:18:09,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36290, dest: /127.0.0.1:50942, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2846812765736743198_1356, duration: 5380603
2013-10-31 16:18:09,768 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2846812765736743198_1356 terminating
2013-10-31 16:18:09,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36358, dest: /127.0.0.1:38271, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2846812765736743198_1356, duration: 3632868
2013-10-31 16:18:09,769 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2846812765736743198_1356 terminating
2013-10-31 16:18:09,769 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49390, dest: /127.0.0.1:47311, bytes: 26369, op: HDFS_WRITE, cliID: DFSClient_695084204, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2846812765736743198_1356, duration: 6255838
2013-10-31 16:18:09,770 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2846812765736743198_1356 terminating
2013-10-31 16:18:09,775 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2846812765736743198_1356 size 26369
2013-10-31 16:18:09,775 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252 from client DFSClient_695084204
2013-10-31 16:18:09,776 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_logs/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252 is closed by DFSClient_695084204
2013-10-31 16:18:09,776 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2846812765736743198_1356 size 26369
2013-10-31 16:18:09,776 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2846812765736743198_1356 size 26369
2013-10-31 16:18:09,784 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0030_1383236265737_hadoop_%5BE4EC0E4BA2CD4E49B23EC80C191F27BB%2F4AD809DC610A4252 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:09,785 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000004_0'
2013-10-31 16:18:09,785 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000005_0'
2013-10-31 16:18:09,786 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5985565395941547146 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,787 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5985565395941547146 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,787 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5985565395941547146 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,791 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0030_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:09,793 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2852820014732100186 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,794 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2852820014732100186 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,794 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2852820014732100186 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,794 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5935025676836584846 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,794 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5935025676836584846 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,795 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5935025676836584846 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,795 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_715915181680467880 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,795 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_715915181680467880 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,795 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_715915181680467880 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,795 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4468907177856788027 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,796 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4468907177856788027 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,796 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4468907177856788027 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0030 dst=null perm=null
2013-10-31 16:18:09,796 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777050699776076643 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,796 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777050699776076643 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777050699776076643 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8577440969405303007 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8577440969405303007 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8577440969405303007 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,798 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5223740880924984010 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,798 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5223740880924984010 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,798 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5223740880924984010 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/4225184497_upper2_7DE2172CD60E4D258701B0C2CFD28D91 dst=null perm=null
2013-10-31 16:18:09,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4844518074889198090 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4844518074889198090 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4844518074889198090 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7470160298863947644 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7470160298863947644 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7470160298863947644 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1663768746748666765 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1663768746748666765 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1663768746748666765 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7018752213662655129 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7018752213662655129 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7018752213662655129 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,808 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4668368595109805817 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,808 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4668368595109805817 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,808 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4668368595109805817 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:09,808 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6018207326177541389 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,809 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6018207326177541389 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,809 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6018207326177541389 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,809 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1513594355081957583 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:09,809 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1513594355081957583 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:09,809 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1513594355081957583 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:09,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/1140836140_upper1_upper2_06805BE504AD47E481BED2FD8013CC68 dst=null perm=null
2013-10-31 16:18:09,816 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary
2013-10-31 16:18:09,823 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:09,823 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0030 being deleted.
2013-10-31 16:18:09,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2013-10-31 16:18:09,826 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:18:09,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2013-10-31 16:18:09,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2013-10-31 16:18:09,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2013-10-31 16:18:09,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2013-10-31 16:18:09,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2013-10-31 16:18:09,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2013-10-31 16:18:09,834 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49394, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1312997292511735196_1352, duration: 297295
2013-10-31 16:18:09,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2013-10-31 16:18:09,836 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36362, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-167795708726022168_1351, duration: 267509
2013-10-31 16:18:09,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2013-10-31 16:18:09,839 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56399, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_669744094790171250_1355, duration: 317284
2013-10-31 16:18:09,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2013-10-31 16:18:09,841 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56400, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3963998881078876696_1355, duration: 292146
2013-10-31 16:18:09,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2013-10-31 16:18:09,843 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36365, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7061817477599287647_1355, duration: 262997
2013-10-31 16:18:09,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2013-10-31 16:18:09,859 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:18:09,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2013-10-31 16:18:09,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2013-10-31 16:18:09,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2013-10-31 16:18:09,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2013-10-31 16:18:09,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2013-10-31 16:18:09,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2013-10-31 16:18:09,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56402, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1312997292511735196_1352, duration: 390643
2013-10-31 16:18:09,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2013-10-31 16:18:09,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49400, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-167795708726022168_1351, duration: 250549
2013-10-31 16:18:09,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2013-10-31 16:18:09,875 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36299, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_669744094790171250_1355, duration: 265556
2013-10-31 16:18:09,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2013-10-31 16:18:09,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36369, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3963998881078876696_1355, duration: 290957
2013-10-31 16:18:09,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2013-10-31 16:18:09,882 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36301, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7061817477599287647_1355, duration: 254606
2013-10-31 16:18:09,882 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsamesourceintojoin
2013-10-31 16:18:09,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2013-10-31 16:18:09,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2013-10-31 16:18:09,890 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49404, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1312997292511735196_1352, duration: 257589
2013-10-31 16:18:09,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2013-10-31 16:18:09,894 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56408, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-167795708726022168_1351, duration: 292495
2013-10-31 16:18:09,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2013-10-31 16:18:09,899 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49406, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_669744094790171250_1355, duration: 285544
2013-10-31 16:18:09,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2013-10-31 16:18:09,903 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36374, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3963998881078876696_1355, duration: 255566
2013-10-31 16:18:09,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2013-10-31 16:18:09,907 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36375, bytes: 16, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7061817477599287647_1355, duration: 254565
2013-10-31 16:18:09,931 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:18:09,932 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:18:09,959 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting
2013-10-31 16:18:09,959 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:18:09,959 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:18:09,960 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt"]
2013-10-31 16:18:09,960 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt"]
2013-10-31 16:18:09,960 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup"]
2013-10-31 16:18:09,961 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] parallel execution is enabled: true
2013-10-31 16:18:09,961 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] starting jobs: 1
2013-10-31 16:18:09,961 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [cogrouping] allocating threads: 1
2013-10-31 16:18:09,962 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] starting step: (1/1) ...platform/joinsintocogroup
2013-10-31 16:18:09,965 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:18:09,965 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:18:09,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:09,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:18:10,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,004 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar. blk_-2293510353387054922_1357
2013-10-31 16:18:10,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:36307 dest: /127.0.0.1:50942
2013-10-31 16:18:10,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:36377 dest: /127.0.0.1:38271
2013-10-31 16:18:10,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:49411 dest: /127.0.0.1:47311
2013-10-31 16:18:10,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49411, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2293510353387054922_1357, duration: 6374989
2013-10-31 16:18:10,019 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2293510353387054922_1357 terminating
2013-10-31 16:18:10,019 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:10,019 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36377, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2293510353387054922_1357, duration: 7525244
2013-10-31 16:18:10,020 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2293510353387054922_1357 terminating
2013-10-31 16:18:10,020 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36307, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2293510353387054922_1357, duration: 8244406
2013-10-31 16:18:10,021 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2293510353387054922_1357 terminating
2013-10-31 16:18:10,022 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:10,023 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar from client DFSClient_1457307213
2013-10-31 16:18:10,023 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar is closed by DFSClient_1457307213
2013-10-31 16:18:10,024 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:10,030 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar. New replication is 10
2013-10-31 16:18:10,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar dst=null perm=null
2013-10-31 16:18:10,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,046 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:18:10,050 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:18:10,053 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:18:10,056 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:18:10,059 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:10,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:18:10,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:10,083 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split. New replication is 10
2013-10-31 16:18:10,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=null
2013-10-31 16:18:10,091 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split. blk_4889450459518297417_1358
2013-10-31 16:18:10,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:49412 dest: /127.0.0.1:47311
2013-10-31 16:18:10,094 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:36311 dest: /127.0.0.1:50942
2013-10-31 16:18:10,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:56417 dest: /127.0.0.1:41648
2013-10-31 16:18:10,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4889450459518297417_1358 src: /127.0.0.1:36382 dest: /127.0.0.1:38271
2013-10-31 16:18:10,101 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36382, dest: /127.0.0.1:38271, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4889450459518297417_1358, duration: 114176
2013-10-31 16:18:10,101 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,102 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56417, dest: /127.0.0.1:41648, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4889450459518297417_1358, duration: 886372
2013-10-31 16:18:10,102 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,103 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36311, dest: /127.0.0.1:50942, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4889450459518297417_1358, duration: 1812337
2013-10-31 16:18:10,103 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,103 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,104 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49412, dest: /127.0.0.1:47311, bytes: 2073, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 2776908
2013-10-31 16:18:10,104 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4889450459518297417_1358 terminating
2013-10-31 16:18:10,107 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,107 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split from client DFSClient_1457307213
2013-10-31 16:18:10,108 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split is closed by DFSClient_1457307213
2013-10-31 16:18:10,108 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,109 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4889450459518297417_1358 size 2073
2013-10-31 16:18:10,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,233 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo. blk_6095635965794745357_1359
2013-10-31 16:18:11,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6095635965794745357_1359 src: /127.0.0.1:49416 dest: /127.0.0.1:47311
2013-10-31 16:18:11,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6095635965794745357_1359 src: /127.0.0.1:36384 dest: /127.0.0.1:38271
2013-10-31 16:18:11,239 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6095635965794745357_1359 src: /127.0.0.1:36316 dest: /127.0.0.1:50942
2013-10-31 16:18:11,242 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36316, dest: /127.0.0.1:50942, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6095635965794745357_1359, duration: 72515
2013-10-31 16:18:11,242 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6095635965794745357_1359 terminating
2013-10-31 16:18:11,243 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36384, dest: /127.0.0.1:38271, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6095635965794745357_1359, duration: 928192
2013-10-31 16:18:11,243 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6095635965794745357_1359 terminating
2013-10-31 16:18:11,244 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6095635965794745357_1359 size 218
2013-10-31 16:18:11,244 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49416, dest: /127.0.0.1:47311, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6095635965794745357_1359, duration: 1927995
2013-10-31 16:18:11,244 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6095635965794745357_1359 terminating
2013-10-31 16:18:11,246 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6095635965794745357_1359 size 218
2013-10-31 16:18:11,247 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:18:11,247 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:18:11,247 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6095635965794745357_1359 size 218
2013-10-31 16:18:11,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,273 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml. blk_1855502406512099239_1360
2013-10-31 16:18:11,275 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1855502406512099239_1360 src: /127.0.0.1:36317 dest: /127.0.0.1:50942
2013-10-31 16:18:11,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1855502406512099239_1360 src: /127.0.0.1:49420 dest: /127.0.0.1:47311
2013-10-31 16:18:11,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1855502406512099239_1360 src: /127.0.0.1:56424 dest: /127.0.0.1:41648
2013-10-31 16:18:11,281 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56424, dest: /127.0.0.1:41648, bytes: 30268, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1855502406512099239_1360, duration: 257386
2013-10-31 16:18:11,282 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1855502406512099239_1360 terminating
2013-10-31 16:18:11,282 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49420, dest: /127.0.0.1:47311, bytes: 30268, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1855502406512099239_1360, duration: 1104809
2013-10-31 16:18:11,283 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1855502406512099239_1360 terminating
2013-10-31 16:18:11,283 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36317, dest: /127.0.0.1:50942, bytes: 30268, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1855502406512099239_1360, duration: 2063221
2013-10-31 16:18:11,284 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1855502406512099239_1360 terminating
2013-10-31 16:18:11,286 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1855502406512099239_1360 size 30268
2013-10-31 16:18:11,287 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml from client DFSClient_1457307213
2013-10-31 16:18:11,287 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml is closed by DFSClient_1457307213
2013-10-31 16:18:11,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1855502406512099239_1360 size 30268
2013-10-31 16:18:11,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1855502406512099239_1360 size 30268
2013-10-31 16:18:11,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml dst=null perm=null
2013-10-31 16:18:11,304 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56426, bytes: 30508, op: HDFS_READ, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1855502406512099239_1360, duration: 403430
2013-10-31 16:18:11,324 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0031: nMaps=6 nReduces=1 max=-1
2013-10-31 16:18:11,324 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0031 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:18:11,324 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0031
2013-10-31 16:18:11,324 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0031 RESULT=SUCCESS
2013-10-31 16:18:11,324 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0031
2013-10-31 16:18:11,325 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [cogrouping] submitted hadoop job: job_20131031160444934_0031
2013-10-31 16:18:11,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,361 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml. blk_32100703911106741_1362
2013-10-31 16:18:11,362 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_32100703911106741_1362 src: /127.0.0.1:49424 dest: /127.0.0.1:47311
2013-10-31 16:18:11,364 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_32100703911106741_1362 src: /127.0.0.1:36392 dest: /127.0.0.1:38271
2013-10-31 16:18:11,366 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_32100703911106741_1362 src: /127.0.0.1:36324 dest: /127.0.0.1:50942
2013-10-31 16:18:11,370 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36324, dest: /127.0.0.1:50942, bytes: 30333, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_32100703911106741_1362, duration: 534062
2013-10-31 16:18:11,370 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_32100703911106741_1362 terminating
2013-10-31 16:18:11,371 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36392, dest: /127.0.0.1:38271, bytes: 30333, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_32100703911106741_1362, duration: 1985217
2013-10-31 16:18:11,371 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_32100703911106741_1362 terminating
2013-10-31 16:18:11,371 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49424, dest: /127.0.0.1:47311, bytes: 30333, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_32100703911106741_1362, duration: 2469968
2013-10-31 16:18:11,372 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_32100703911106741_1362 terminating
2013-10-31 16:18:11,375 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_32100703911106741_1362 size 30333
2013-10-31 16:18:11,375 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml from client DFSClient_-290827983
2013-10-31 16:18:11,375 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_conf.xml is closed by DFSClient_-290827983
2013-10-31 16:18:11,376 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_32100703911106741_1362 size 30333
2013-10-31 16:18:11,376 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_32100703911106741_1362 size 30333
2013-10-31 16:18:11,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:11,394 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken. blk_-4541719979601510441_1363
2013-10-31 16:18:11,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4541719979601510441_1363 src: /127.0.0.1:49427 dest: /127.0.0.1:47311
2013-10-31 16:18:11,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4541719979601510441_1363 src: /127.0.0.1:36326 dest: /127.0.0.1:50942
2013-10-31 16:18:11,398 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4541719979601510441_1363 src: /127.0.0.1:36396 dest: /127.0.0.1:38271
2013-10-31 16:18:11,401 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36396, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4541719979601510441_1363, duration: 83050
2013-10-31 16:18:11,402 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4541719979601510441_1363 terminating
2013-10-31 16:18:11,402 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36326, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4541719979601510441_1363, duration: 928016
2013-10-31 16:18:11,403 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4541719979601510441_1363 terminating
2013-10-31 16:18:11,403 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49427, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4541719979601510441_1363, duration: 1974047
2013-10-31 16:18:11,404 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4541719979601510441_1363 terminating
2013-10-31 16:18:11,407 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4541719979601510441_1363 size 116
2013-10-31 16:18:11,407 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4541719979601510441_1363 size 116
2013-10-31 16:18:11,408 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken from client DFSClient_1457307213
2013-10-31 16:18:11,408 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken is closed by DFSClient_1457307213
2013-10-31 16:18:11,408 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4541719979601510441_1363 size 116
2013-10-31 16:18:11,415 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken
2013-10-31 16:18:11,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.splitmetainfo dst=null perm=null
2013-10-31 16:18:11,419 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36328, bytes: 222, op: HDFS_READ, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6095635965794745357_1359, duration: 360010
2013-10-31 16:18:11,420 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0031 = 71. Number of splits = 6
2013-10-31 16:18:11,420 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,421 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0031_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:11,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0031 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:18:11,425 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0031 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 16:18:11,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8878127457679220121_1347 file build/test/data/dfs/data/data1/current/blk_-8878127457679220121 for deletion
2013-10-31 16:18:11,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8492324455653831791_1344 file build/test/data/dfs/data/data2/current/blk_-8492324455653831791 for deletion
2013-10-31 16:18:11,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8878127457679220121_1347 at file build/test/data/dfs/data/data1/current/blk_-8878127457679220121
2013-10-31 16:18:11,892 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6914640943678526682_1346 file build/test/data/dfs/data/data2/current/blk_-6914640943678526682 for deletion
2013-10-31 16:18:11,893 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8492324455653831791_1344 at file build/test/data/dfs/data/data2/current/blk_-8492324455653831791
2013-10-31 16:18:11,893 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1824606275897357057_1345 file build/test/data/dfs/data/data1/current/blk_1824606275897357057 for deletion
2013-10-31 16:18:11,893 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6914640943678526682_1346 at file build/test/data/dfs/data/data2/current/blk_-6914640943678526682
2013-10-31 16:18:11,893 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1824606275897357057_1345 at file build/test/data/dfs/data/data1/current/blk_1824606275897357057
2013-10-31 16:18:12,336 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-2293510353387054922_1357 to datanode(s) 127.0.0.1:41648
2013-10-31 16:18:12,336 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_7470160298863947644_1336 blk_7018752213662655129_1339 blk_777050699776076643_1329 blk_4468907177856788027_1325 blk_5935025676836584846_1323 blk_-1663768746748666765_1339 blk_-4668368595109805817_1342 blk_-4844518074889198090_1343
2013-10-31 16:18:12,336 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_7470160298863947644_1336 blk_-1513594355081957583_1342 blk_777050699776076643_1329 blk_7018752213662655129_1339 blk_4468907177856788027_1325 blk_5935025676836584846_1323 blk_-5985565395941547146_1350 blk_-1663768746748666765_1339 blk_2852820014732100186_1330 blk_715915181680467880_1326 blk_8577440969405303007_1329 blk_-4668368595109805817_1342 blk_6018207326177541389_1341 blk_5223740880924984010_1329 blk_-4844518074889198090_1343
2013-10-31 16:18:12,492 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5985565395941547146_1350 file build/test/data/dfs/data/data3/current/blk_-5985565395941547146 for deletion
2013-10-31 16:18:12,492 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4844518074889198090_1343 file build/test/data/dfs/data/data4/current/blk_-4844518074889198090 for deletion
2013-10-31 16:18:12,492 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5985565395941547146_1350 at file build/test/data/dfs/data/data3/current/blk_-5985565395941547146
2013-10-31 16:18:12,494 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4844518074889198090_1343 at file build/test/data/dfs/data/data4/current/blk_-4844518074889198090
2013-10-31 16:18:12,494 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4668368595109805817_1342 file build/test/data/dfs/data/data4/current/blk_-4668368595109805817 for deletion
2013-10-31 16:18:12,494 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1663768746748666765_1339 file build/test/data/dfs/data/data4/current/blk_-1663768746748666765 for deletion
2013-10-31 16:18:12,495 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4668368595109805817_1342 at file build/test/data/dfs/data/data4/current/blk_-4668368595109805817
2013-10-31 16:18:12,495 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1513594355081957583_1342 file build/test/data/dfs/data/data3/current/blk_-1513594355081957583 for deletion
2013-10-31 16:18:12,495 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1663768746748666765_1339 at file build/test/data/dfs/data/data4/current/blk_-1663768746748666765
2013-10-31 16:18:12,495 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_715915181680467880_1326 file build/test/data/dfs/data/data3/current/blk_715915181680467880 for deletion
2013-10-31 16:18:12,495 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1513594355081957583_1342 at file build/test/data/dfs/data/data3/current/blk_-1513594355081957583
2013-10-31 16:18:12,496 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777050699776076643_1329 file build/test/data/dfs/data/data3/current/blk_777050699776076643 for deletion
2013-10-31 16:18:12,496 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_715915181680467880_1326 at file build/test/data/dfs/data/data3/current/blk_715915181680467880
2013-10-31 16:18:12,496 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2852820014732100186_1330 file build/test/data/dfs/data/data3/current/blk_2852820014732100186 for deletion
2013-10-31 16:18:12,496 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777050699776076643_1329 at file build/test/data/dfs/data/data3/current/blk_777050699776076643
2013-10-31 16:18:12,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4468907177856788027_1325 file build/test/data/dfs/data/data4/current/blk_4468907177856788027 for deletion
2013-10-31 16:18:12,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2852820014732100186_1330 at file build/test/data/dfs/data/data3/current/blk_2852820014732100186
2013-10-31 16:18:12,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4468907177856788027_1325 at file build/test/data/dfs/data/data4/current/blk_4468907177856788027
2013-10-31 16:18:12,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5223740880924984010_1329 file build/test/data/dfs/data/data4/current/blk_5223740880924984010 for deletion
2013-10-31 16:18:12,498 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5935025676836584846_1323 file build/test/data/dfs/data/data3/current/blk_5935025676836584846 for deletion
2013-10-31 16:18:12,498 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5223740880924984010_1329 at file build/test/data/dfs/data/data4/current/blk_5223740880924984010
2013-10-31 16:18:12,498 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5935025676836584846_1323 at file build/test/data/dfs/data/data3/current/blk_5935025676836584846
2013-10-31 16:18:12,498 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6018207326177541389_1341 file build/test/data/dfs/data/data3/current/blk_6018207326177541389 for deletion
2013-10-31 16:18:12,499 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7018752213662655129_1339 file build/test/data/dfs/data/data3/current/blk_7018752213662655129 for deletion
2013-10-31 16:18:12,499 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6018207326177541389_1341 at file build/test/data/dfs/data/data3/current/blk_6018207326177541389
2013-10-31 16:18:12,499 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7470160298863947644_1336 file build/test/data/dfs/data/data4/current/blk_7470160298863947644 for deletion
2013-10-31 16:18:12,499 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7018752213662655129_1339 at file build/test/data/dfs/data/data3/current/blk_7018752213662655129
2013-10-31 16:18:12,499 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7470160298863947644_1336 at file build/test/data/dfs/data/data4/current/blk_7470160298863947644
2013-10-31 16:18:12,499 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8577440969405303007_1329 file build/test/data/dfs/data/data4/current/blk_8577440969405303007 for deletion
2013-10-31 16:18:12,500 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8577440969405303007_1329 at file build/test/data/dfs/data/data4/current/blk_8577440969405303007
2013-10-31 16:18:12,734 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0031_m_000007_0' to tip task_20131031160444934_0031_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:12,742 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000000_0'
2013-10-31 16:18:12,742 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000001_0'
2013-10-31 16:18:12,742 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000006_0'
2013-10-31 16:18:12,744 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000007_0 task's state:UNASSIGNED
2013-10-31 16:18:12,744 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000007_0 which needs 1 slots
2013-10-31 16:18:12,745 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000007_0 which needs 1 slots
2013-10-31 16:18:12,746 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000002_0'
2013-10-31 16:18:12,746 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0030_m_000003_0'
2013-10-31 16:18:12,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken dst=null perm=null
2013-10-31 16:18:12,755 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49431, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4541719979601510441_1363, duration: 349528
2013-10-31 16:18:12,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml dst=null perm=null
2013-10-31 16:18:12,765 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36331, bytes: 30508, op: HDFS_READ, cliID: DFSClient_-1507310307, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1855502406512099239_1360, duration: 414782
2013-10-31 16:18:12,795 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:12,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar dst=null perm=null
2013-10-31 16:18:12,820 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49434, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1507310307, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2293510353387054922_1357, duration: 1488794
2013-10-31 16:18:12,912 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0030_m_407080348
2013-10-31 16:18:12,918 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28679 with signal TERM. Exit code 0
2013-10-31 16:18:12,918 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_1525606085
2013-10-31 16:18:12,919 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_1525606085 spawned.
2013-10-31 16:18:12,920 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000007_0/taskjvm.sh
2013-10-31 16:18:13,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4844518074889198090_1343 file build/test/data/dfs/data/data6/current/blk_-4844518074889198090 for deletion
2013-10-31 16:18:13,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4668368595109805817_1342 file build/test/data/dfs/data/data5/current/blk_-4668368595109805817 for deletion
2013-10-31 16:18:13,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4844518074889198090_1343 at file build/test/data/dfs/data/data6/current/blk_-4844518074889198090
2013-10-31 16:18:13,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1663768746748666765_1339 file build/test/data/dfs/data/data6/current/blk_-1663768746748666765 for deletion
2013-10-31 16:18:13,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4668368595109805817_1342 at file build/test/data/dfs/data/data5/current/blk_-4668368595109805817
2013-10-31 16:18:13,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1663768746748666765_1339 at file build/test/data/dfs/data/data6/current/blk_-1663768746748666765
2013-10-31 16:18:13,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777050699776076643_1329 file build/test/data/dfs/data/data6/current/blk_777050699776076643 for deletion
2013-10-31 16:18:13,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4468907177856788027_1325 file build/test/data/dfs/data/data5/current/blk_4468907177856788027 for deletion
2013-10-31 16:18:13,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777050699776076643_1329 at file build/test/data/dfs/data/data6/current/blk_777050699776076643
2013-10-31 16:18:13,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4468907177856788027_1325 at file build/test/data/dfs/data/data5/current/blk_4468907177856788027
2013-10-31 16:18:13,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5935025676836584846_1323 file build/test/data/dfs/data/data5/current/blk_5935025676836584846 for deletion
2013-10-31 16:18:13,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7018752213662655129_1339 file build/test/data/dfs/data/data5/current/blk_7018752213662655129 for deletion
2013-10-31 16:18:13,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5935025676836584846_1323 at file build/test/data/dfs/data/data5/current/blk_5935025676836584846
2013-10-31 16:18:13,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7470160298863947644_1336 file build/test/data/dfs/data/data5/current/blk_7470160298863947644 for deletion
2013-10-31 16:18:13,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7018752213662655129_1339 at file build/test/data/dfs/data/data5/current/blk_7018752213662655129
2013-10-31 16:18:13,113 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7470160298863947644_1336 at file build/test/data/dfs/data/data5/current/blk_7470160298863947644
2013-10-31 16:18:13,638 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:13,638 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:13,639 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:13,639 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_407080348 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:18:14,496 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1525606085 given task: attempt_20131031160444934_0031_m_000007_0
2013-10-31 16:18:14,787 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:14,787 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000005_0 not found in cache
2013-10-31 16:18:14,787 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000004_0 not found in cache
2013-10-31 16:18:14,787 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0030 for user-log deletion with retainTimeStamp:1383322694787
2013-10-31 16:18:14,790 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_-1035919601 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:14,794 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29177 with signal TERM. Exit code 0
2013-10-31 16:18:14,942 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:14,942 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:14,942 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:14,943 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_-1035919601 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:14,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:15,103 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-2293510353387054922_1357 to 127.0.0.1:41648
2013-10-31 16:18:15,105 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2293510353387054922_1357 src: /127.0.0.1:56440 dest: /127.0.0.1:41648
2013-10-31 16:18:15,106 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-2293510353387054922_1357 to /127.0.0.1:41648
2013-10-31 16:18:15,109 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2293510353387054922_1357 src: /127.0.0.1:56440 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:18:15,113 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2293510353387054922_1357 size 238055
2013-10-31 16:18:15,337 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_6018207326177541389_1341 blk_7470160298863947644_1336 blk_5223740880924984010_1329 blk_-1513594355081957583_1342 blk_777050699776076643_1329 blk_5935025676836584846_1323 blk_-1663768746748666765_1339 blk_-5985565395941547146_1350 blk_2852820014732100186_1330 blk_715915181680467880_1326 blk_8577440969405303007_1329 blk_-4668368595109805817_1342
2013-10-31 16:18:15,338 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_6018207326177541389_1341 blk_5223740880924984010_1329 blk_-1513594355081957583_1342 blk_7018752213662655129_1339 blk_4468907177856788027_1325 blk_-5985565395941547146_1350 blk_2852820014732100186_1330 blk_715915181680467880_1326 blk_8577440969405303007_1329 blk_-4844518074889198090_1343
2013-10-31 16:18:15,581 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_-469071112 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:15,592 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28935 with signal TERM. Exit code 0
2013-10-31 16:18:15,763 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:15,764 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:15,764 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:15,764 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_-469071112 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:17,745 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:17,745 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000000_0 not found in cache
2013-10-31 16:18:17,745 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000001_0 not found in cache
2013-10-31 16:18:17,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0030 for user-log deletion with retainTimeStamp:1383322697746
2013-10-31 16:18:17,747 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0030
2013-10-31 16:18:17,748 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000003_0 not found in cache
2013-10-31 16:18:17,748 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0030_m_000002_0 not found in cache
2013-10-31 16:18:17,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0030 for user-log deletion with retainTimeStamp:1383322697748
2013-10-31 16:18:17,894 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5985565395941547146_1350 file build/test/data/dfs/data/data1/current/blk_-5985565395941547146 for deletion
2013-10-31 16:18:17,894 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4844518074889198090_1343 file build/test/data/dfs/data/data1/current/blk_-4844518074889198090 for deletion
2013-10-31 16:18:17,894 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5985565395941547146_1350 at file build/test/data/dfs/data/data1/current/blk_-5985565395941547146
2013-10-31 16:18:17,894 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1513594355081957583_1342 file build/test/data/dfs/data/data2/current/blk_-1513594355081957583 for deletion
2013-10-31 16:18:17,895 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4844518074889198090_1343 at file build/test/data/dfs/data/data1/current/blk_-4844518074889198090
2013-10-31 16:18:17,895 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_715915181680467880_1326 file build/test/data/dfs/data/data2/current/blk_715915181680467880 for deletion
2013-10-31 16:18:17,895 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1513594355081957583_1342 at file build/test/data/dfs/data/data2/current/blk_-1513594355081957583
2013-10-31 16:18:17,895 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2852820014732100186_1330 file build/test/data/dfs/data/data1/current/blk_2852820014732100186 for deletion
2013-10-31 16:18:17,895 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_715915181680467880_1326 at file build/test/data/dfs/data/data2/current/blk_715915181680467880
2013-10-31 16:18:17,896 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4468907177856788027_1325 file build/test/data/dfs/data/data1/current/blk_4468907177856788027 for deletion
2013-10-31 16:18:17,896 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2852820014732100186_1330 at file build/test/data/dfs/data/data1/current/blk_2852820014732100186
2013-10-31 16:18:17,896 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5223740880924984010_1329 file build/test/data/dfs/data/data2/current/blk_5223740880924984010 for deletion
2013-10-31 16:18:17,896 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4468907177856788027_1325 at file build/test/data/dfs/data/data1/current/blk_4468907177856788027
2013-10-31 16:18:17,896 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6018207326177541389_1341 file build/test/data/dfs/data/data1/current/blk_6018207326177541389 for deletion
2013-10-31 16:18:17,897 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5223740880924984010_1329 at file build/test/data/dfs/data/data2/current/blk_5223740880924984010
2013-10-31 16:18:17,897 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6018207326177541389_1341 at file build/test/data/dfs/data/data1/current/blk_6018207326177541389
2013-10-31 16:18:17,897 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7018752213662655129_1339 file build/test/data/dfs/data/data2/current/blk_7018752213662655129 for deletion
2013-10-31 16:18:17,898 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8577440969405303007_1329 file build/test/data/dfs/data/data1/current/blk_8577440969405303007 for deletion
2013-10-31 16:18:17,898 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7018752213662655129_1339 at file build/test/data/dfs/data/data2/current/blk_7018752213662655129
2013-10-31 16:18:17,898 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8577440969405303007_1329 at file build/test/data/dfs/data/data1/current/blk_8577440969405303007
2013-10-31 16:18:17,917 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000007_0 0.0% setup
2013-10-31 16:18:17,922 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000007_0 is done.
2013-10-31 16:18:17,922 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000007_0 was -1
2013-10-31 16:18:17,922 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:18,105 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5985565395941547146_1350 file build/test/data/dfs/data/data8/current/blk_-5985565395941547146 for deletion
2013-10-31 16:18:18,105 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4668368595109805817_1342 file build/test/data/dfs/data/data8/current/blk_-4668368595109805817 for deletion
2013-10-31 16:18:18,105 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5985565395941547146_1350 at file build/test/data/dfs/data/data8/current/blk_-5985565395941547146
2013-10-31 16:18:18,106 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1663768746748666765_1339 file build/test/data/dfs/data/data8/current/blk_-1663768746748666765 for deletion
2013-10-31 16:18:18,106 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4668368595109805817_1342 at file build/test/data/dfs/data/data8/current/blk_-4668368595109805817
2013-10-31 16:18:18,106 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1513594355081957583_1342 file build/test/data/dfs/data/data7/current/blk_-1513594355081957583 for deletion
2013-10-31 16:18:18,106 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1663768746748666765_1339 at file build/test/data/dfs/data/data8/current/blk_-1663768746748666765
2013-10-31 16:18:18,106 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_715915181680467880_1326 file build/test/data/dfs/data/data8/current/blk_715915181680467880 for deletion
2013-10-31 16:18:18,106 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1513594355081957583_1342 at file build/test/data/dfs/data/data7/current/blk_-1513594355081957583
2013-10-31 16:18:18,107 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_715915181680467880_1326 at file build/test/data/dfs/data/data8/current/blk_715915181680467880
2013-10-31 16:18:18,107 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777050699776076643_1329 file build/test/data/dfs/data/data8/current/blk_777050699776076643 for deletion
2013-10-31 16:18:18,107 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2852820014732100186_1330 file build/test/data/dfs/data/data8/current/blk_2852820014732100186 for deletion
2013-10-31 16:18:18,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777050699776076643_1329 at file build/test/data/dfs/data/data8/current/blk_777050699776076643
2013-10-31 16:18:18,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5223740880924984010_1329 file build/test/data/dfs/data/data7/current/blk_5223740880924984010 for deletion
2013-10-31 16:18:18,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2852820014732100186_1330 at file build/test/data/dfs/data/data8/current/blk_2852820014732100186
2013-10-31 16:18:18,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5935025676836584846_1323 file build/test/data/dfs/data/data8/current/blk_5935025676836584846 for deletion
2013-10-31 16:18:18,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5223740880924984010_1329 at file build/test/data/dfs/data/data7/current/blk_5223740880924984010
2013-10-31 16:18:18,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6018207326177541389_1341 file build/test/data/dfs/data/data7/current/blk_6018207326177541389 for deletion
2013-10-31 16:18:18,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5935025676836584846_1323 at file build/test/data/dfs/data/data8/current/blk_5935025676836584846
2013-10-31 16:18:18,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6018207326177541389_1341 at file build/test/data/dfs/data/data7/current/blk_6018207326177541389
2013-10-31 16:18:18,109 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7470160298863947644_1336 file build/test/data/dfs/data/data7/current/blk_7470160298863947644 for deletion
2013-10-31 16:18:18,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8577440969405303007_1329 file build/test/data/dfs/data/data7/current/blk_8577440969405303007 for deletion
2013-10-31 16:18:18,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7470160298863947644_1336 at file build/test/data/dfs/data/data7/current/blk_7470160298863947644
2013-10-31 16:18:18,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8577440969405303007_1329 at file build/test/data/dfs/data/data7/current/blk_8577440969405303007
2013-10-31 16:18:18,466 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_767723640 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:18,476 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28896 with signal TERM. Exit code 0
2013-10-31 16:18:18,559 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0030_m_1871656188 since job job_20131031160444934_0030 is dead
2013-10-31 16:18:18,564 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28936 with signal TERM. Exit code 0
2013-10-31 16:18:18,684 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:18,684 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:18,684 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:18,685 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_767723640 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:18,704 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:18,705 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:18,705 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:18,705 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_1871656188 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:18,751 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000007_0' has completed task_20131031160444934_0031_m_000007 successfully.
2013-10-31 16:18:18,754 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000000_0' to tip task_20131031160444934_0031_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:18,755 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000000
2013-10-31 16:18:18,756 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000001_0' to tip task_20131031160444934_0031_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:18,756 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000001
2013-10-31 16:18:18,758 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000002_0' to tip task_20131031160444934_0031_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:18:18,759 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:18:18,760 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000002
2013-10-31 16:18:18,761 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:18:18,761 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000003_0' to tip task_20131031160444934_0031_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:18:18,761 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000000_0 which needs 1 slots
2013-10-31 16:18:18,761 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000000_0 which needs 1 slots
2013-10-31 16:18:18,761 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000003
2013-10-31 16:18:18,762 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000001_0 which needs 1 slots
2013-10-31 16:18:18,762 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0031_m_000001_0 which needs 1 slots
2013-10-31 16:18:18,768 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:18:18,769 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:18:18,770 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000002_0 which needs 1 slots
2013-10-31 16:18:18,770 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000002_0 which needs 1 slots
2013-10-31 16:18:18,770 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000003_0 which needs 1 slots
2013-10-31 16:18:18,771 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0031_m_000003_0 which needs 1 slots
2013-10-31 16:18:18,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken dst=null perm=null
2013-10-31 16:18:18,779 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36336, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4541719979601510441_1363, duration: 287806
2013-10-31 16:18:18,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml dst=null perm=null
2013-10-31 16:18:18,790 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36338, bytes: 30508, op: HDFS_READ, cliID: DFSClient_-739213233, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1855502406512099239_1360, duration: 505809
2013-10-31 16:18:18,796 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000004_0' to tip task_20131031160444934_0031_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:18:18,796 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000004
2013-10-31 16:18:18,797 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0031_m_000005_0' to tip task_20131031160444934_0031_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:18:18,797 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0031_m_000005
2013-10-31 16:18:18,802 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:18:18,802 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:18:18,802 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000004_0 which needs 1 slots
2013-10-31 16:18:18,802 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000004_0 which needs 1 slots
2013-10-31 16:18:18,803 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000005_0 which needs 1 slots
2013-10-31 16:18:18,803 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0031_m_000005_0 which needs 1 slots
2013-10-31 16:18:18,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031/jobToken dst=null perm=null
2013-10-31 16:18:18,810 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0031/attempt_20131031160444934_0031_m_000001_0. Attempting to reuse: jvm_20131031160444934_0031_m_1525606085
2013-10-31 16:18:18,811 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0030_m_357915176
2013-10-31 16:18:18,811 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36339, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4541719979601510441_1363, duration: 839604
2013-10-31 16:18:18,815 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28830 with signal TERM. Exit code 0
2013-10-31 16:18:18,815 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-1669483909
2013-10-31 16:18:18,817 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-1669483909 spawned.
2013-10-31 16:18:18,820 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000000_0/taskjvm.sh
2013-10-31 16:18:18,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.xml dst=null perm=null
2013-10-31 16:18:18,825 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56446, bytes: 30508, op: HDFS_READ, cliID: DFSClient_1990509339, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1855502406512099239_1360, duration: 387824
2013-10-31 16:18:18,866 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:18,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar dst=null perm=null
2013-10-31 16:18:18,892 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49444, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1990509339, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2293510353387054922_1357, duration: 585290
2013-10-31 16:18:18,893 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:18,893 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:18,893 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:18,893 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0030_m_357915176 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:18,945 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-2127491649
2013-10-31 16:18:18,946 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-2127491649 spawned.
2013-10-31 16:18:18,948 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000004_0/taskjvm.sh
2013-10-31 16:18:18,967 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_1249270322
2013-10-31 16:18:18,968 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_1249270322 spawned.
2013-10-31 16:18:18,969 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000005_0/taskjvm.sh
2013-10-31 16:18:19,267 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1525606085 given task: attempt_20131031160444934_0031_m_000001_0
2013-10-31 16:18:19,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=null
2013-10-31 16:18:19,390 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36344, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4889450459518297417_1358, duration: 400264
2013-10-31 16:18:19,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:18:19,432 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36345, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4001027560673372033_1084, duration: 251796
2013-10-31 16:18:19,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:18:19,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:18:19,754 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36415, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 285226
2013-10-31 16:18:20,528 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:20,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.jar dst=null perm=null
2013-10-31 16:18:20,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36416, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-739213233, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2293510353387054922_1357, duration: 1456597
2013-10-31 16:18:20,916 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-1679966884
2013-10-31 16:18:20,916 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-1679966884 spawned.
2013-10-31 16:18:20,917 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_m_-1457722047
2013-10-31 16:18:20,917 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_m_-1457722047 spawned.
2013-10-31 16:18:20,918 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000002_0/taskjvm.sh
2013-10-31 16:18:20,919 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_m_000003_0/taskjvm.sh
2013-10-31 16:18:21,375 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-1669483909 given task: attempt_20131031160444934_0031_m_000000_0
2013-10-31 16:18:21,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=null
2013-10-31 16:18:21,880 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49454, bytes: 2093, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 178024
2013-10-31 16:18:21,924 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1249270322 given task: attempt_20131031160444934_0031_m_000005_0
2013-10-31 16:18:21,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt dst=null perm=null
2013-10-31 16:18:21,952 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-2127491649 given task: attempt_20131031160444934_0031_m_000004_0
2013-10-31 16:18:22,120 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-1457722047 given task: attempt_20131031160444934_0031_m_000003_0
2013-10-31 16:18:22,161 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_-1679966884 given task: attempt_20131031160444934_0031_m_000002_0
2013-10-31 16:18:22,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:18:22,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs.txt dst=null perm=null
2013-10-31 16:18:22,244 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36424, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1539762991683523844_1085, duration: 149134
2013-10-31 16:18:22,248 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56461, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4001027560673372033_1084, duration: 116152
2013-10-31 16:18:22,352 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:26+26
2013-10-31 16:18:22,353 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000001_0 is done.
2013-10-31 16:18:22,353 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000001_0 was 564
2013-10-31 16:18:22,354 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:22,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=null
2013-10-31 16:18:22,447 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49461, bytes: 545, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000005_0, offset: 1536, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 157757
2013-10-31 16:18:22,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=null
2013-10-31 16:18:22,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49462, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 144855
2013-10-31 16:18:22,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:18:22,487 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49463, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000005_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 107684
2013-10-31 16:18:22,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:18:22,493 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49464, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 101934
2013-10-31 16:18:22,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=null
2013-10-31 16:18:22,643 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49467, bytes: 1061, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4889450459518297417_1358, duration: 161704
2013-10-31 16:18:22,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031/job.split dst=null perm=null
2013-10-31 16:18:22,663 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36366, bytes: 1577, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4889450459518297417_1358, duration: 152804
2013-10-31 16:18:22,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:18:22,683 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36367, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 137065
2013-10-31 16:18:22,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:18:22,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36368, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000005_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 1390532
2013-10-31 16:18:22,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,786 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56474, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 129920
2013-10-31 16:18:22,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,973 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36370, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 144779
2013-10-31 16:18:22,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:18:22,988 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49473, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 105543
2013-10-31 16:18:22,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36372, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0031_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 123276
2013-10-31 16:18:23,761 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0031_m_000007_0
2013-10-31 16:18:23,762 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0031_m_000007_0
2013-10-31 16:18:23,762 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0031_m_000007_0 not found in cache
2013-10-31 16:18:24,764 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000001_0' has completed task_20131031160444934_0031_m_000001 successfully.
2013-10-31 16:18:24,766 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0031_r_000000_0' to tip task_20131031160444934_0031_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:24,769 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:18:24,769 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_r_000000_0 which needs 1 slots
2013-10-31 16:18:24,769 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_r_000000_0 which needs 1 slots
2013-10-31 16:18:24,805 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs.txt:0+26
2013-10-31 16:18:24,807 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0031_r_-825662118
2013-10-31 16:18:24,808 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0031_r_-825662118 spawned.
2013-10-31 16:18:24,808 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000000_0 is done.
2013-10-31 16:18:24,808 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000000_0 was 595
2013-10-31 16:18:24,809 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:24,811 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0031/attempt_20131031160444934_0031_r_000000_0/taskjvm.sh
2013-10-31 16:18:25,372 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000005_0 0.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:18+1
2013-10-31 16:18:25,374 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000005_0 is done.
2013-10-31 16:18:25,374 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000005_0 was 6
2013-10-31 16:18:25,374 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:25,379 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+6
2013-10-31 16:18:25,380 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000004_0 is done.
2013-10-31 16:18:25,380 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000004_0 was 68
2013-10-31 16:18:25,380 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:25,561 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:6+6
2013-10-31 16:18:25,563 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000003_0 is done.
2013-10-31 16:18:25,563 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000003_0 was 37
2013-10-31 16:18:25,563 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:25,589 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+6
2013-10-31 16:18:25,590 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000002_0 is done.
2013-10-31 16:18:25,590 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000002_0 was 68
2013-10-31 16:18:25,590 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:26,055 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_r_-825662118 given task: attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:27,771 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000000_0' has completed task_20131031160444934_0031_m_000000 successfully.
2013-10-31 16:18:27,778 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000002_0' has completed task_20131031160444934_0031_m_000002 successfully.
2013-10-31 16:18:27,779 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000003_0' has completed task_20131031160444934_0031_m_000003 successfully.
2013-10-31 16:18:27,808 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000004_0' has completed task_20131031160444934_0031_m_000004 successfully.
2013-10-31 16:18:27,809 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000005_0' has completed task_20131031160444934_0031_m_000005 successfully.
2013-10-31 16:18:31,739 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48169, bytes: 564, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000001_0, duration: 10924526
2013-10-31 16:18:31,765 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48169, bytes: 595, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000000_0, duration: 11963329
2013-10-31 16:18:31,783 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60102, bytes: 68, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000002_0, duration: 13090663
2013-10-31 16:18:31,798 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60102, bytes: 37, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000003_0, duration: 11348065
2013-10-31 16:18:31,816 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44305, bytes: 68, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000004_0, duration: 13019891
2013-10-31 16:18:31,833 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44306, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0031_m_000005_0, duration: 11893389
2013-10-31 16:18:32,531 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:32,585 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:32,642 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:32,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:32,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:32,923 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000. blk_6379554650965270610_1364
2013-10-31 16:18:32,959 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6379554650965270610_1364 src: /127.0.0.1:36380 dest: /127.0.0.1:50942
2013-10-31 16:18:32,961 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6379554650965270610_1364 src: /127.0.0.1:49483 dest: /127.0.0.1:47311
2013-10-31 16:18:32,961 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6379554650965270610_1364 src: /127.0.0.1:56487 dest: /127.0.0.1:41648
2013-10-31 16:18:32,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56487, dest: /127.0.0.1:41648, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0031_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6379554650965270610_1364, duration: 3186810
2013-10-31 16:18:32,967 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6379554650965270610_1364 terminating
2013-10-31 16:18:32,967 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49483, dest: /127.0.0.1:47311, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0031_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6379554650965270610_1364, duration: 4511655
2013-10-31 16:18:32,967 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6379554650965270610_1364 terminating
2013-10-31 16:18:32,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36380, dest: /127.0.0.1:50942, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0031_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6379554650965270610_1364, duration: 4885016
2013-10-31 16:18:32,968 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6379554650965270610_1364 terminating
2013-10-31 16:18:32,970 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6379554650965270610_1364 size 592
2013-10-31 16:18:32,971 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:32,971 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:32,971 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6379554650965270610_1364 size 592
2013-10-31 16:18:32,971 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6379554650965270610_1364 size 592
2013-10-31 16:18:33,013 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0031_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:33,014 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 16:18:33,781 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031160444934_0031_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:34092
2013-10-31 16:18:33,782 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:34,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0 dst=null perm=null
2013-10-31 16:18:34,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:34,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:34,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary/_attempt_20131031160444934_0031_r_000000_0 dst=null perm=null
2013-10-31 16:18:35,585 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 1.0% reduce > reduce
2013-10-31 16:18:35,588 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_r_000000_0 1.0% reduce > reduce
2013-10-31 16:18:35,589 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_r_000000_0 is done.
2013-10-31 16:18:35,590 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_r_000000_0 was -1
2013-10-31 16:18:35,590 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:36,786 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_r_000000_0' has completed task_20131031160444934_0031_r_000000 successfully.
2013-10-31 16:18:36,789 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0031_m_000006_0' to tip task_20131031160444934_0031_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:36,791 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0031_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:18:36,792 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0031_m_000006_0 which needs 1 slots
2013-10-31 16:18:36,792 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0031_m_000006_0 which needs 1 slots
2013-10-31 16:18:36,830 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0031/attempt_20131031160444934_0031_m_000006_0. Attempting to reuse: jvm_20131031160444934_0031_m_1525606085
2013-10-31 16:18:37,885 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0031_m_1525606085 given task: attempt_20131031160444934_0031_m_000006_0
2013-10-31 16:18:37,988 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000006_0 0.0%
2013-10-31 16:18:37,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary dst=null perm=null
2013-10-31 16:18:38,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:38,013 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS from client DFSClient_attempt_20131031160444934_0031_m_000006_0
2013-10-31 16:18:38,013 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0031_m_000006_0
2013-10-31 16:18:38,022 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,023 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,023 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:38,023 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2293510353387054922 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:38,023 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:38,023 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,023 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,023 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4889450459518297417 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:38,024 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6095635965794745357 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:38,024 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6095635965794745357 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,024 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6095635965794745357 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,024 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1855502406512099239 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:18:38,024 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1855502406512099239 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:38,024 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1855502406512099239 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:38,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0031 dst=null perm=null
2013-10-31 16:18:39,342 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_1855502406512099239_1360 blk_-2293510353387054922_1357 blk_6095635965794745357_1359 blk_4889450459518297417_1358
2013-10-31 16:18:39,342 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-2293510353387054922_1357 blk_6095635965794745357_1359 blk_4889450459518297417_1358
2013-10-31 16:18:39,847 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:18:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,869 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,874 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,880 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,885 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,890 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:18:39,890 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:18:40,961 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0031_m_000006_0 0.0% cleanup
2013-10-31 16:18:40,963 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0031_m_000006_0 is done.
2013-10-31 16:18:40,963 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0031_m_000006_0 was -1
2013-10-31 16:18:40,963 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:41,792 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:41,792 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0031_r_000000_0
2013-10-31 16:18:41,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data2/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:41,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data1/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:41,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data2/current/blk_-2293510353387054922
2013-10-31 16:18:41,903 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data1/current/blk_4889450459518297417
2013-10-31 16:18:41,902 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6095635965794745357_1359 file build/test/data/dfs/data/data2/current/blk_6095635965794745357 for deletion
2013-10-31 16:18:41,903 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6095635965794745357_1359 at file build/test/data/dfs/data/data2/current/blk_6095635965794745357
2013-10-31 16:18:42,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data8/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:42,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1855502406512099239_1360 file build/test/data/dfs/data/data7/current/blk_1855502406512099239 for deletion
2013-10-31 16:18:42,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data7/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:42,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1855502406512099239_1360 at file build/test/data/dfs/data/data7/current/blk_1855502406512099239
2013-10-31 16:18:42,113 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6095635965794745357_1359 file build/test/data/dfs/data/data8/current/blk_6095635965794745357 for deletion
2013-10-31 16:18:42,113 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data7/current/blk_4889450459518297417
2013-10-31 16:18:42,112 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data8/current/blk_-2293510353387054922
2013-10-31 16:18:42,113 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6095635965794745357_1359 at file build/test/data/dfs/data/data8/current/blk_6095635965794745357
2013-10-31 16:18:42,343 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_1855502406512099239_1360 blk_-2293510353387054922_1357 blk_4889450459518297417_1358
2013-10-31 16:18:42,343 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_1855502406512099239_1360 blk_-2293510353387054922_1357 blk_6095635965794745357_1359 blk_4889450459518297417_1358
2013-10-31 16:18:42,502 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data4/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:42,502 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1855502406512099239_1360 file build/test/data/dfs/data/data3/current/blk_1855502406512099239 for deletion
2013-10-31 16:18:42,502 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data4/current/blk_-2293510353387054922
2013-10-31 16:18:42,502 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1855502406512099239_1360 at file build/test/data/dfs/data/data3/current/blk_1855502406512099239
2013-10-31 16:18:42,502 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data3/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:42,503 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6095635965794745357_1359 file build/test/data/dfs/data/data4/current/blk_6095635965794745357 for deletion
2013-10-31 16:18:42,503 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data3/current/blk_4889450459518297417
2013-10-31 16:18:42,504 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6095635965794745357_1359 at file build/test/data/dfs/data/data4/current/blk_6095635965794745357
2013-10-31 16:18:42,799 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0031_m_000006_0' has completed task_20131031160444934_0031_m_000006 successfully.
2013-10-31 16:18:42,800 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0031 has completed successfully.
2013-10-31 16:18:42,801 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0031,submitTime=1383236291295,launchTime=1383236291425,firstMapTaskLaunchTime=1383236298754,firstReduceTaskLaunchTime=1383236304766,firstJobSetupTaskLaunchTime=1383236292734,firstJobCleanupTaskLaunchTime=1383236316789,finishTime=1383236322800,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=41,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D96525F7519540D2B864433F7B9A034C/CAD0F875B066468E827D7271B68B25B0] cogrouping/(1/1) ...platform/joinsintocogroup
2013-10-31 16:18:42,805 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E. blk_-5164497478515678768_1365
2013-10-31 16:18:42,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5164497478515678768_1365 src: /127.0.0.1:56493 dest: /127.0.0.1:41648
2013-10-31 16:18:42,811 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5164497478515678768_1365 src: /127.0.0.1:36458 dest: /127.0.0.1:38271
2013-10-31 16:18:42,814 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5164497478515678768_1365 src: /127.0.0.1:49492 dest: /127.0.0.1:47311
2013-10-31 16:18:42,819 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49492, dest: /127.0.0.1:47311, bytes: 35430, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5164497478515678768_1365, duration: 2725697
2013-10-31 16:18:42,820 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5164497478515678768_1365 terminating
2013-10-31 16:18:42,820 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36458, dest: /127.0.0.1:38271, bytes: 35430, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5164497478515678768_1365, duration: 3604649
2013-10-31 16:18:42,821 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5164497478515678768_1365 terminating
2013-10-31 16:18:42,821 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56493, dest: /127.0.0.1:41648, bytes: 35430, op: HDFS_WRITE, cliID: DFSClient_-290827983, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5164497478515678768_1365, duration: 4464644
2013-10-31 16:18:42,822 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5164497478515678768_1365 terminating
2013-10-31 16:18:42,827 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5164497478515678768_1365 size 35430
2013-10-31 16:18:42,832 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E from client DFSClient_-290827983
2013-10-31 16:18:42,833 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_logs/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E is closed by DFSClient_-290827983
2013-10-31 16:18:42,833 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5164497478515678768_1365 size 35430
2013-10-31 16:18:42,833 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5164497478515678768_1365 size 35430
2013-10-31 16:18:42,843 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0031_1383236291295_hadoop_%5BD96525F7519540D2B864433F7B9A034C%2FCAD0F875B066468E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:42,844 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000000_0'
2013-10-31 16:18:42,845 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000001_0'
2013-10-31 16:18:42,845 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000006_0'
2013-10-31 16:18:42,846 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000007_0'
2013-10-31 16:18:42,846 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4541719979601510441 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:18:42,847 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_r_000000_0'
2013-10-31 16:18:42,847 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4541719979601510441 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:18:42,847 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4541719979601510441 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:18:42,847 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000004_0'
2013-10-31 16:18:42,848 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000005_0'
2013-10-31 16:18:42,848 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000002_0'
2013-10-31 16:18:42,848 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0031_m_000003_0'
2013-10-31 16:18:42,850 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0031_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:18:42,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0031 dst=null perm=null
2013-10-31 16:18:42,855 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/_temporary
2013-10-31 16:18:42,855 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:42,855 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0031 being deleted.
2013-10-31 16:18:42,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2013-10-31 16:18:42,875 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:42,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2013-10-31 16:18:42,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2013-10-31 16:18:42,880 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49494, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6379554650965270610_1364, duration: 399758
2013-10-31 16:18:42,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2013-10-31 16:18:42,899 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:42,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2013-10-31 16:18:42,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2013-10-31 16:18:42,904 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36393, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6379554650965270610_1364, duration: 371250
2013-10-31 16:18:42,905 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joinsintocogroup
2013-10-31 16:18:42,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2013-10-31 16:18:42,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2013-10-31 16:18:42,914 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36394, bytes: 600, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6379554650965270610_1364, duration: 414123
2013-10-31 16:18:42,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:42,924 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt. blk_-8193683770357719291_1366
2013-10-31 16:18:42,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8193683770357719291_1366 src: /127.0.0.1:56500 dest: /127.0.0.1:41648
2013-10-31 16:18:42,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8193683770357719291_1366 src: /127.0.0.1:36465 dest: /127.0.0.1:38271
2013-10-31 16:18:42,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8193683770357719291_1366 src: /127.0.0.1:49499 dest: /127.0.0.1:47311
2013-10-31 16:18:42,932 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49499, dest: /127.0.0.1:47311, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 65568
2013-10-31 16:18:42,932 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8193683770357719291_1366 terminating
2013-10-31 16:18:42,933 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36465, dest: /127.0.0.1:38271, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8193683770357719291_1366, duration: 901927
2013-10-31 16:18:42,933 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8193683770357719291_1366 terminating
2013-10-31 16:18:42,934 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56500, dest: /127.0.0.1:41648, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 1801755
2013-10-31 16:18:42,934 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8193683770357719291_1366 terminating
2013-10-31 16:18:42,934 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8193683770357719291_1366 size 83
2013-10-31 16:18:42,937 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt from client DFSClient_1457307213
2013-10-31 16:18:42,938 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt is closed by DFSClient_1457307213
2013-10-31 16:18:42,938 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8193683770357719291_1366 size 83
2013-10-31 16:18:42,939 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8193683770357719291_1366 size 83
2013-10-31 16:18:42,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:42,958 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt. blk_863628976355473469_1367
2013-10-31 16:18:42,960 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_863628976355473469_1367 src: /127.0.0.1:36467 dest: /127.0.0.1:38271
2013-10-31 16:18:42,961 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_863628976355473469_1367 src: /127.0.0.1:49501 dest: /127.0.0.1:47311
2013-10-31 16:18:42,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_863628976355473469_1367 src: /127.0.0.1:56505 dest: /127.0.0.1:41648
2013-10-31 16:18:42,980 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56505, dest: /127.0.0.1:41648, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 846303
2013-10-31 16:18:42,981 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_863628976355473469_1367 terminating
2013-10-31 16:18:42,981 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_863628976355473469_1367 size 48
2013-10-31 16:18:42,981 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49501, dest: /127.0.0.1:47311, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_863628976355473469_1367, duration: 1653170
2013-10-31 16:18:42,982 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_863628976355473469_1367 terminating
2013-10-31 16:18:42,982 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36467, dest: /127.0.0.1:38271, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 2677191
2013-10-31 16:18:42,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_863628976355473469_1367 terminating
2013-10-31 16:18:42,986 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_863628976355473469_1367 size 48
2013-10-31 16:18:42,986 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt from client DFSClient_1457307213
2013-10-31 16:18:42,987 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt is closed by DFSClient_1457307213
2013-10-31 16:18:42,989 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_863628976355473469_1367 size 48
2013-10-31 16:18:43,023 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:18:43,024 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:18:43,042 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:18:43,042 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt"]
2013-10-31 16:18:43,043 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt"]
2013-10-31 16:18:43,043 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner"]
2013-10-31 16:18:43,044 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:18:43,044 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:18:43,044 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:18:43,045 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...edpipesplatform/joininner
2013-10-31 16:18:43,048 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:18:43,048 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:18:43,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:43,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:18:43,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,072 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar. blk_4073126747153669157_1368
2013-10-31 16:18:43,074 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:36470 dest: /127.0.0.1:38271
2013-10-31 16:18:43,075 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:36402 dest: /127.0.0.1:50942
2013-10-31 16:18:43,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:56508 dest: /127.0.0.1:41648
2013-10-31 16:18:43,085 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56508, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4073126747153669157_1368, duration: 3937184
2013-10-31 16:18:43,086 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4073126747153669157_1368 terminating
2013-10-31 16:18:43,086 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36402, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4073126747153669157_1368, duration: 4725331
2013-10-31 16:18:43,087 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4073126747153669157_1368 terminating
2013-10-31 16:18:43,087 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36470, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4073126747153669157_1368, duration: 5817952
2013-10-31 16:18:43,088 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4073126747153669157_1368 terminating
2013-10-31 16:18:43,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:43,090 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar from client DFSClient_1457307213
2013-10-31 16:18:43,090 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar is closed by DFSClient_1457307213
2013-10-31 16:18:43,091 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:43,092 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:43,097 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar. New replication is 10
2013-10-31 16:18:43,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar dst=null perm=null
2013-10-31 16:18:43,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,114 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:18:43,118 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:18:43,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2293510353387054922_1357 file build/test/data/dfs/data/data6/current/blk_-2293510353387054922 for deletion
2013-10-31 16:18:43,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1855502406512099239_1360 file build/test/data/dfs/data/data5/current/blk_1855502406512099239 for deletion
2013-10-31 16:18:43,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:18:43,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4889450459518297417_1358 file build/test/data/dfs/data/data6/current/blk_4889450459518297417 for deletion
2013-10-31 16:18:43,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1855502406512099239_1360 at file build/test/data/dfs/data/data5/current/blk_1855502406512099239
2013-10-31 16:18:43,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2293510353387054922_1357 at file build/test/data/dfs/data/data6/current/blk_-2293510353387054922
2013-10-31 16:18:43,120 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4889450459518297417_1358 at file build/test/data/dfs/data/data6/current/blk_4889450459518297417
2013-10-31 16:18:43,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:43,132 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split. New replication is 10
2013-10-31 16:18:44,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=null
2013-10-31 16:18:44,591 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split. blk_2094033281312644685_1369
2013-10-31 16:18:44,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:36473 dest: /127.0.0.1:38271
2013-10-31 16:18:44,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:56510 dest: /127.0.0.1:41648
2013-10-31 16:18:44,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:36406 dest: /127.0.0.1:50942
2013-10-31 16:18:44,598 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2094033281312644685_1369 src: /127.0.0.1:49509 dest: /127.0.0.1:47311
2013-10-31 16:18:44,601 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49509, dest: /127.0.0.1:47311, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2094033281312644685_1369, duration: 119932
2013-10-31 16:18:44,602 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,602 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36406, dest: /127.0.0.1:50942, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2094033281312644685_1369, duration: 998518
2013-10-31 16:18:44,603 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,603 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56510, dest: /127.0.0.1:41648, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2094033281312644685_1369, duration: 1929265
2013-10-31 16:18:44,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,604 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,604 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36473, dest: /127.0.0.1:38271, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2094033281312644685_1369, duration: 2826568
2013-10-31 16:18:44,605 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2094033281312644685_1369 terminating
2013-10-31 16:18:44,609 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,609 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split from client DFSClient_1457307213
2013-10-31 16:18:44,610 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split is closed by DFSClient_1457307213
2013-10-31 16:18:44,610 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,610 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2094033281312644685_1369 size 1757
2013-10-31 16:18:44,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:44,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:44,630 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo. blk_5130222379336307247_1370
2013-10-31 16:18:44,631 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5130222379336307247_1370 src: /127.0.0.1:36408 dest: /127.0.0.1:50942
2013-10-31 16:18:44,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5130222379336307247_1370 src: /127.0.0.1:56514 dest: /127.0.0.1:41648
2013-10-31 16:18:44,634 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5130222379336307247_1370 src: /127.0.0.1:49512 dest: /127.0.0.1:47311
2013-10-31 16:18:44,637 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49512, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5130222379336307247_1370, duration: 65307
2013-10-31 16:18:44,638 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5130222379336307247_1370 terminating
2013-10-31 16:18:44,638 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56514, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5130222379336307247_1370, duration: 811197
2013-10-31 16:18:44,639 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5130222379336307247_1370 terminating
2013-10-31 16:18:44,639 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36408, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5130222379336307247_1370, duration: 1698262
2013-10-31 16:18:44,640 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5130222379336307247_1370 terminating
2013-10-31 16:18:44,642 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5130222379336307247_1370 size 183
2013-10-31 16:18:44,642 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5130222379336307247_1370 size 183
2013-10-31 16:18:44,643 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5130222379336307247_1370 size 183
2013-10-31 16:18:45,042 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:18:45,043 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:18:45,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,074 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml. blk_-5302370728116882745_1371
2013-10-31 16:18:45,075 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5302370728116882745_1371 src: /127.0.0.1:36411 dest: /127.0.0.1:50942
2013-10-31 16:18:45,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5302370728116882745_1371 src: /127.0.0.1:56517 dest: /127.0.0.1:41648
2013-10-31 16:18:45,079 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5302370728116882745_1371 src: /127.0.0.1:36482 dest: /127.0.0.1:38271
2013-10-31 16:18:45,082 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36482, dest: /127.0.0.1:38271, bytes: 28971, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5302370728116882745_1371, duration: 218749
2013-10-31 16:18:45,082 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5302370728116882745_1371 terminating
2013-10-31 16:18:45,082 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56517, dest: /127.0.0.1:41648, bytes: 28971, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5302370728116882745_1371, duration: 977782
2013-10-31 16:18:45,083 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5302370728116882745_1371 size 28971
2013-10-31 16:18:45,083 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5302370728116882745_1371 terminating
2013-10-31 16:18:45,084 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36411, dest: /127.0.0.1:50942, bytes: 28971, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5302370728116882745_1371, duration: 2227790
2013-10-31 16:18:45,084 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5302370728116882745_1371 terminating
2013-10-31 16:18:45,084 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5302370728116882745_1371 size 28971
2013-10-31 16:18:45,087 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml from client DFSClient_1457307213
2013-10-31 16:18:45,087 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml is closed by DFSClient_1457307213
2013-10-31 16:18:45,087 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5302370728116882745_1371 size 28971
2013-10-31 16:18:45,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml dst=null perm=null
2013-10-31 16:18:45,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36415, bytes: 29199, op: HDFS_READ, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5302370728116882745_1371, duration: 383179
2013-10-31 16:18:45,123 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0032: nMaps=5 nReduces=0 max=-1
2013-10-31 16:18:45,123 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0032 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:18:45,123 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0032
2013-10-31 16:18:45,123 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0032 RESULT=SUCCESS
2013-10-31 16:18:45,124 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0032
2013-10-31 16:18:45,125 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0032
2013-10-31 16:18:45,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,157 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml. blk_-3532042759540428294_1373
2013-10-31 16:18:45,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3532042759540428294_1373 src: /127.0.0.1:49518 dest: /127.0.0.1:47311
2013-10-31 16:18:45,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3532042759540428294_1373 src: /127.0.0.1:36417 dest: /127.0.0.1:50942
2013-10-31 16:18:45,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3532042759540428294_1373 src: /127.0.0.1:36487 dest: /127.0.0.1:38271
2013-10-31 16:18:45,166 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36487, dest: /127.0.0.1:38271, bytes: 29036, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3532042759540428294_1373, duration: 656950
2013-10-31 16:18:45,166 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3532042759540428294_1373 terminating
2013-10-31 16:18:45,166 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3532042759540428294_1373 size 29036
2013-10-31 16:18:45,167 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36417, dest: /127.0.0.1:50942, bytes: 29036, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3532042759540428294_1373, duration: 1907150
2013-10-31 16:18:45,167 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3532042759540428294_1373 terminating
2013-10-31 16:18:45,168 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49518, dest: /127.0.0.1:47311, bytes: 29036, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3532042759540428294_1373, duration: 2526186
2013-10-31 16:18:45,168 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3532042759540428294_1373 terminating
2013-10-31 16:18:45,171 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3532042759540428294_1373 size 29036
2013-10-31 16:18:45,171 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml from client DFSClient_-519505853
2013-10-31 16:18:45,172 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_conf.xml is closed by DFSClient_-519505853
2013-10-31 16:18:45,172 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3532042759540428294_1373 size 29036
2013-10-31 16:18:45,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:45,187 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken. blk_1424133611784958048_1374
2013-10-31 16:18:45,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424133611784958048_1374 src: /127.0.0.1:56524 dest: /127.0.0.1:41648
2013-10-31 16:18:45,190 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424133611784958048_1374 src: /127.0.0.1:36420 dest: /127.0.0.1:50942
2013-10-31 16:18:45,192 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424133611784958048_1374 src: /127.0.0.1:49523 dest: /127.0.0.1:47311
2013-10-31 16:18:45,195 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49523, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1424133611784958048_1374, duration: 64084
2013-10-31 16:18:45,195 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1424133611784958048_1374 terminating
2013-10-31 16:18:45,195 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36420, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1424133611784958048_1374, duration: 899017
2013-10-31 16:18:45,196 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1424133611784958048_1374 terminating
2013-10-31 16:18:45,196 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1424133611784958048_1374 size 116
2013-10-31 16:18:45,196 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56524, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1424133611784958048_1374, duration: 1736905
2013-10-31 16:18:45,197 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1424133611784958048_1374 size 116
2013-10-31 16:18:45,197 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1424133611784958048_1374 terminating
2013-10-31 16:18:45,200 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1424133611784958048_1374 size 116
2013-10-31 16:18:45,200 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken from client DFSClient_1457307213
2013-10-31 16:18:45,200 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken is closed by DFSClient_1457307213
2013-10-31 16:18:45,208 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken
2013-10-31 16:18:45,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.splitmetainfo dst=null perm=null
2013-10-31 16:18:45,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56527, bytes: 187, op: HDFS_READ, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5130222379336307247_1370, duration: 270146
2013-10-31 16:18:45,213 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0032 = 83. Number of splits = 5
2013-10-31 16:18:45,214 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,214 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,214 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,215 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,216 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0032_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:18:45,217 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0032 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:18:45,218 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0032 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:18:45,344 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_4073126747153669157_1368 to datanode(s) 127.0.0.1:47311
2013-10-31 16:18:45,344 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-4541719979601510441_1363
2013-10-31 16:18:45,344 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-4541719979601510441_1363
2013-10-31 16:18:45,503 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4541719979601510441_1363 file build/test/data/dfs/data/data3/current/blk_-4541719979601510441 for deletion
2013-10-31 16:18:45,503 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4541719979601510441_1363 at file build/test/data/dfs/data/data3/current/blk_-4541719979601510441
2013-10-31 16:18:45,852 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0032_m_000006_0' to tip task_20131031160444934_0032_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:45,860 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:18:45,860 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000006_0 which needs 1 slots
2013-10-31 16:18:45,861 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000006_0 which needs 1 slots
2013-10-31 16:18:45,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken dst=null perm=null
2013-10-31 16:18:45,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49525, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1424133611784958048_1374, duration: 278968
2013-10-31 16:18:45,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml dst=null perm=null
2013-10-31 16:18:45,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36494, bytes: 29199, op: HDFS_READ, cliID: DFSClient_1914595330, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5302370728116882745_1371, duration: 384030
2013-10-31 16:18:45,910 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:45,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar dst=null perm=null
2013-10-31 16:18:45,937 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36495, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1914595330, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4073126747153669157_1368, duration: 1178927
2013-10-31 16:18:46,032 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0031_m_-1669483909
2013-10-31 16:18:46,036 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29530 with signal TERM. Exit code 0
2013-10-31 16:18:46,036 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_915869845
2013-10-31 16:18:46,037 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_915869845 spawned.
2013-10-31 16:18:46,040 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000006_0/taskjvm.sh
2013-10-31 16:18:46,153 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:46,153 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:46,153 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:46,154 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-1669483909 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:47,799 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_915869845 given task: attempt_20131031160444934_0032_m_000006_0
2013-10-31 16:18:47,848 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:47,848 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0031_m_000006_0 not found in cache
2013-10-31 16:18:47,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0031 for user-log deletion with retainTimeStamp:1383322727848
2013-10-31 16:18:47,848 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:47,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0031 for user-log deletion with retainTimeStamp:1383322727849
2013-10-31 16:18:47,849 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0031
2013-10-31 16:18:47,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0031 for user-log deletion with retainTimeStamp:1383322727849
2013-10-31 16:18:47,903 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_4073126747153669157_1368 to 127.0.0.1:47311
2013-10-31 16:18:47,903 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4541719979601510441_1363 file build/test/data/dfs/data/data2/current/blk_-4541719979601510441 for deletion
2013-10-31 16:18:47,904 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4541719979601510441_1363 at file build/test/data/dfs/data/data2/current/blk_-4541719979601510441
2013-10-31 16:18:47,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4073126747153669157_1368 src: /127.0.0.1:49530 dest: /127.0.0.1:47311
2013-10-31 16:18:47,904 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_4073126747153669157_1368 to /127.0.0.1:47311
2013-10-31 16:18:47,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_4073126747153669157_1368 src: /127.0.0.1:49530 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:18:47,907 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4073126747153669157_1368 size 238055
2013-10-31 16:18:48,133 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_r_-825662118 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,140 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29831 with signal TERM. Exit code 0
2013-10-31 16:18:48,288 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,289 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,289 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:48,289 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_r_-825662118 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:48,345 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-4541719979601510441_1363
2013-10-31 16:18:48,435 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_1249270322 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,448 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29580 with signal TERM. Exit code 0
2013-10-31 16:18:48,448 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_-2127491649 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,464 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29579 with signal TERM. Exit code 0
2013-10-31 16:18:48,621 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_-1457722047 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,627 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29651 with signal TERM. Exit code 0
2013-10-31 16:18:48,649 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_-1679966884 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:48,653 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29650 with signal TERM. Exit code 0
2013-10-31 16:18:48,659 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,659 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,659 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,659 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,659 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:48,659 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:48,660 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_1249270322 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,660 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-2127491649 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,826 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,827 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,827 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:48,828 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-1457722047 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:48,849 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:48,849 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:48,849 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:48,850 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_-1679966884 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:18:49,003 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0031_m_1525606085 since job job_20131031160444934_0031 is dead
2013-10-31 16:18:49,012 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29352 with signal TERM. Exit code 0
2013-10-31 16:18:49,210 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:18:49,210 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:18:49,210 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:18:49,211 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0031_m_1525606085 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:18:51,114 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4541719979601510441_1363 file build/test/data/dfs/data/data7/current/blk_-4541719979601510441 for deletion
2013-10-31 16:18:51,115 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4541719979601510441_1363 at file build/test/data/dfs/data/data7/current/blk_-4541719979601510441
2013-10-31 16:18:51,225 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000006_0 0.0% setup
2013-10-31 16:18:51,228 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000006_0 is done.
2013-10-31 16:18:51,229 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000006_0 was -1
2013-10-31 16:18:51,229 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:51,905 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000006_0' has completed task_20131031160444934_0032_m_000006 successfully.
2013-10-31 16:18:51,909 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000000_0' to tip task_20131031160444934_0032_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:51,910 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000000
2013-10-31 16:18:51,910 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000001_0' to tip task_20131031160444934_0032_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:18:51,911 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000001
2013-10-31 16:18:51,913 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:18:51,914 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:18:51,914 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000000_0 which needs 1 slots
2013-10-31 16:18:51,915 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000000_0 which needs 1 slots
2013-10-31 16:18:51,915 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000001_0 which needs 1 slots
2013-10-31 16:18:51,915 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0032_m_000001_0 which needs 1 slots
2013-10-31 16:18:51,943 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000002_0' to tip task_20131031160444934_0032_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:18:51,943 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000002
2013-10-31 16:18:51,943 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000003_0' to tip task_20131031160444934_0032_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:18:51,944 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000003
2013-10-31 16:18:51,945 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:18:51,946 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:18:51,946 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000002_0 which needs 1 slots
2013-10-31 16:18:51,946 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000002_0 which needs 1 slots
2013-10-31 16:18:51,946 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000003_0 which needs 1 slots
2013-10-31 16:18:51,946 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0032_m_000003_0 which needs 1 slots
2013-10-31 16:18:51,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken dst=null perm=null
2013-10-31 16:18:51,950 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56535, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1424133611784958048_1374, duration: 141643
2013-10-31 16:18:51,953 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_-307560193
2013-10-31 16:18:51,953 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_-307560193 spawned.
2013-10-31 16:18:51,954 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0032/attempt_20131031160444934_0032_m_000001_0. Attempting to reuse: jvm_20131031160444934_0032_m_915869845
2013-10-31 16:18:51,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml dst=null perm=null
2013-10-31 16:18:51,955 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000000_0/taskjvm.sh
2013-10-31 16:18:51,956 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36501, bytes: 29199, op: HDFS_READ, cliID: DFSClient_487799539, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5302370728116882745_1371, duration: 160746
2013-10-31 16:18:52,030 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:52,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar dst=null perm=null
2013-10-31 16:18:52,058 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49536, bytes: 239915, op: HDFS_READ, cliID: DFSClient_487799539, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4073126747153669157_1368, duration: 1194008
2013-10-31 16:18:52,098 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_915869845 given task: attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:52,147 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_2061442510
2013-10-31 16:18:52,148 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_2061442510 spawned.
2013-10-31 16:18:52,149 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_-1891823038
2013-10-31 16:18:52,149 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_-1891823038 spawned.
2013-10-31 16:18:52,150 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000002_0/taskjvm.sh
2013-10-31 16:18:52,150 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000003_0/taskjvm.sh
2013-10-31 16:18:52,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=null
2013-10-31 16:18:52,434 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56541, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2094033281312644685_1369, duration: 163960
2013-10-31 16:18:52,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:18:52,473 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36506, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8193683770357719291_1366, duration: 100560
2013-10-31 16:18:52,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:52,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:52,889 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_-307560193 given task: attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:52,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:52,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:52,918 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49541, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_863628976355473469_1367, duration: 124416
2013-10-31 16:18:52,928 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001. blk_5905163722231129390_1375
2013-10-31 16:18:52,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5905163722231129390_1375 src: /127.0.0.1:49542 dest: /127.0.0.1:47311
2013-10-31 16:18:52,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5905163722231129390_1375 src: /127.0.0.1:56546 dest: /127.0.0.1:41648
2013-10-31 16:18:52,946 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5905163722231129390_1375 src: /127.0.0.1:36442 dest: /127.0.0.1:50942
2013-10-31 16:18:52,949 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36442, dest: /127.0.0.1:50942, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5905163722231129390_1375, duration: 1658012
2013-10-31 16:18:52,949 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5905163722231129390_1375 terminating
2013-10-31 16:18:52,949 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5905163722231129390_1375 size 30
2013-10-31 16:18:52,949 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56546, dest: /127.0.0.1:41648, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5905163722231129390_1375, duration: 1766809
2013-10-31 16:18:52,949 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5905163722231129390_1375 terminating
2013-10-31 16:18:52,950 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49542, dest: /127.0.0.1:47311, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5905163722231129390_1375, duration: 2308719
2013-10-31 16:18:52,950 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5905163722231129390_1375 terminating
2013-10-31 16:18:52,951 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5905163722231129390_1375 size 30
2013-10-31 16:18:52,951 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5905163722231129390_1375 size 30
2013-10-31 16:18:52,952 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:52,952 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:52,996 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:52,997 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000001_0 0.0%
2013-10-31 16:18:53,363 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_2061442510 given task: attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:53,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=null
2013-10-31 16:18:53,413 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49548, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2094033281312644685_1369, duration: 169791
2013-10-31 16:18:53,439 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_-1891823038 given task: attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:53,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:18:53,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:53,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:53,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:53,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:53,701 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36516, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 129777
2013-10-31 16:18:53,705 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36517, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8193683770357719291_1366, duration: 100085
2013-10-31 16:18:53,714 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000. blk_7773255689976018768_1376
2013-10-31 16:18:53,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7773255689976018768_1376 src: /127.0.0.1:49551 dest: /127.0.0.1:47311
2013-10-31 16:18:53,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7773255689976018768_1376 src: /127.0.0.1:56555 dest: /127.0.0.1:41648
2013-10-31 16:18:53,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7773255689976018768_1376 src: /127.0.0.1:36451 dest: /127.0.0.1:50942
2013-10-31 16:18:53,741 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36451, dest: /127.0.0.1:50942, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7773255689976018768_1376, duration: 1164756
2013-10-31 16:18:53,742 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7773255689976018768_1376 terminating
2013-10-31 16:18:53,742 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56555, dest: /127.0.0.1:41648, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7773255689976018768_1376, duration: 1501426
2013-10-31 16:18:53,742 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7773255689976018768_1376 terminating
2013-10-31 16:18:53,742 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49551, dest: /127.0.0.1:47311, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7773255689976018768_1376, duration: 1983173
2013-10-31 16:18:53,743 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7773255689976018768_1376 terminating
2013-10-31 16:18:53,745 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7773255689976018768_1376 size 120
2013-10-31 16:18:53,746 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7773255689976018768_1376 size 120
2013-10-31 16:18:53,747 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7773255689976018768_1376 size 120
2013-10-31 16:18:53,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=null
2013-10-31 16:18:53,887 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36523, bytes: 1257, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2094033281312644685_1369, duration: 209232
2013-10-31 16:18:53,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:18:53,926 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49557, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 100582
2013-10-31 16:18:53,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:53,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=null
2013-10-31 16:18:53,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:53,952 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56561, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2094033281312644685_1369, duration: 213189
2013-10-31 16:18:53,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:18:53,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56562, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 117899
2013-10-31 16:18:54,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:54,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:54,144 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:54,145 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:54,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:54,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:54,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56563, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 123463
2013-10-31 16:18:54,187 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:54,187 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:54,192 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:54,192 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000000_0 0.0%
2013-10-31 16:18:54,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:54,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:54,230 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36528, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 154545
2013-10-31 16:18:54,231 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:54,232 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000002_0 0.0%
2013-10-31 16:18:54,239 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:54,239 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:54,284 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:54,284 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000003_0 0.0%
2013-10-31 16:18:54,868 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0032_m_000004_0' to tip task_20131031160444934_0032_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:18:54,868 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0032_m_000004
2013-10-31 16:18:54,871 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:18:54,871 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000004_0 which needs 1 slots
2013-10-31 16:18:54,871 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000004_0 which needs 1 slots
2013-10-31 16:18:54,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032/jobToken dst=null perm=null
2013-10-31 16:18:54,880 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36461, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1424133611784958048_1374, duration: 333953
2013-10-31 16:18:54,880 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 68 raw values into 2 aggregated values, total 4
2013-10-31 16:18:54,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.xml dst=null perm=null
2013-10-31 16:18:54,891 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56568, bytes: 29199, op: HDFS_READ, cliID: DFSClient_-1146601161, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5302370728116882745_1371, duration: 420319
2013-10-31 16:18:54,917 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000000_0
2013-10-31 16:18:54,917 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000001_0
2013-10-31 16:18:54,918 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:18:54,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.jar dst=null perm=null
2013-10-31 16:18:54,951 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000002_0
2013-10-31 16:18:54,952 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000003_0
2013-10-31 16:18:54,953 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56569, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1146601161, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4073126747153669157_1368, duration: 1472240
2013-10-31 16:18:55,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0 dst=null perm=null
2013-10-31 16:18:55,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:55,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:55,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000001_0 dst=null perm=null
2013-10-31 16:18:55,069 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_1107410354
2013-10-31 16:18:55,070 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_1107410354 spawned.
2013-10-31 16:18:55,072 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000004_0/taskjvm.sh
2013-10-31 16:18:55,398 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:20+20
2013-10-31 16:18:55,399 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000001_0 is done.
2013-10-31 16:18:55,399 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000001_0 was -1
2013-10-31 16:18:55,399 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:56,915 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0032_m_000006_0
2013-10-31 16:18:56,915 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0032_m_000006_0
2013-10-31 16:18:56,915 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000006_0 not found in cache
2013-10-31 16:18:56,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0 dst=null perm=null
2013-10-31 16:18:56,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0 dst=null perm=null
2013-10-31 16:18:56,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0 dst=null perm=null
2013-10-31 16:18:56,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:56,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:56,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:57,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:57,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:57,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:57,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000000_0 dst=null perm=null
2013-10-31 16:18:57,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000002_0 dst=null perm=null
2013-10-31 16:18:57,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000003_0 dst=null perm=null
2013-10-31 16:18:57,807 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_1107410354 given task: attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:18:57,919 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000001_0' has completed task_20131031160444934_0032_m_000001 successfully.
2013-10-31 16:18:58,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032/job.split dst=null perm=null
2013-10-31 16:18:58,296 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36536, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2094033281312644685_1369, duration: 251171
2013-10-31 16:18:58,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:18:58,335 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49570, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 253159
2013-10-31 16:18:58,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:18:58,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:18:58,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:58,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:18:58,599 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49571, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_863628976355473469_1367, duration: 136924
2013-10-31 16:18:58,611 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004. blk_-223779029298134025_1379
2013-10-31 16:18:58,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-223779029298134025_1379 src: /127.0.0.1:49572 dest: /127.0.0.1:47311
2013-10-31 16:18:58,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-223779029298134025_1379 src: /127.0.0.1:56576 dest: /127.0.0.1:41648
2013-10-31 16:18:58,655 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-223779029298134025_1379 src: /127.0.0.1:36472 dest: /127.0.0.1:50942
2013-10-31 16:18:58,657 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36472, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-223779029298134025_1379, duration: 1302164
2013-10-31 16:18:58,657 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-223779029298134025_1379 terminating
2013-10-31 16:18:58,657 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56576, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-223779029298134025_1379, duration: 1450116
2013-10-31 16:18:58,658 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-223779029298134025_1379 terminating
2013-10-31 16:18:58,658 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49572, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0032_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-223779029298134025_1379, duration: 1929462
2013-10-31 16:18:58,658 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-223779029298134025_1379 size 8
2013-10-31 16:18:58,658 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-223779029298134025_1379 terminating
2013-10-31 16:18:58,659 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:18:58,660 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:18:58,661 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-223779029298134025_1379 size 8
2013-10-31 16:18:58,662 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-223779029298134025_1379 size 8
2013-10-31 16:18:58,731 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0032_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:18:58,731 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000004_0 0.0%
2013-10-31 16:18:59,399 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:18:59,408 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:18:59,409 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000000_0 is done.
2013-10-31 16:18:59,409 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000000_0 was -1
2013-10-31 16:18:59,409 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:18:59,847 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:18:59,851 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:18:59,852 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000002_0 is done.
2013-10-31 16:18:59,852 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000002_0 was -1
2013-10-31 16:18:59,853 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:18:59,912 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:18:59,916 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:18:59,916 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000003_0 is done.
2013-10-31 16:18:59,916 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000003_0 was -1
2013-10-31 16:18:59,917 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:00,877 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0032_m_000004_0
2013-10-31 16:19:00,923 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000000_0' has completed task_20131031160444934_0032_m_000000 successfully.
2013-10-31 16:19:00,956 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000002_0' has completed task_20131031160444934_0032_m_000002 successfully.
2013-10-31 16:19:00,957 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000003_0' has completed task_20131031160444934_0032_m_000003 successfully.
2013-10-31 16:19:01,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0 dst=null perm=null
2013-10-31 16:19:01,750 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2021 Total time for transactions(ms): 43Number of transactions batched in Syncs: 224 Number of syncs: 1449 SyncTimes(ms): 66889 13760
2013-10-31 16:19:01,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:01,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:01,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary/_attempt_20131031160444934_0032_m_000004_0 dst=null perm=null
2013-10-31 16:19:02,084 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3172384662314539439_1009
2013-10-31 16:19:04,297 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:19:04,299 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:19:04,299 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000004_0 is done.
2013-10-31 16:19:04,300 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000004_0 was -1
2013-10-31 16:19:04,300 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:06,884 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000004_0' has completed task_20131031160444934_0032_m_000004 successfully.
2013-10-31 16:19:06,887 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0032_m_000005_0' to tip task_20131031160444934_0032_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:06,890 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0032_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:19:06,890 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0032_m_000005_0 which needs 1 slots
2013-10-31 16:19:06,890 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0032_m_000005_0 which needs 1 slots
2013-10-31 16:19:06,929 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0032_m_1898439609
2013-10-31 16:19:06,930 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0032_m_1898439609 spawned.
2013-10-31 16:19:06,933 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0032/attempt_20131031160444934_0032_m_000005_0/taskjvm.sh
2013-10-31 16:19:07,825 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0032_m_1898439609 given task: attempt_20131031160444934_0032_m_000005_0
2013-10-31 16:19:08,353 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000005_0 0.0%
2013-10-31 16:19:08,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary dst=null perm=null
2013-10-31 16:19:08,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:08,377 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_SUCCESS from client DFSClient_attempt_20131031160444934_0032_m_000005_0
2013-10-31 16:19:08,377 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0032_m_000005_0
2013-10-31 16:19:08,384 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,384 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,384 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:08,384 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4073126747153669157 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:08,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:08,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:08,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2094033281312644685 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,385 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5130222379336307247 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5130222379336307247 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:08,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5130222379336307247 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5302370728116882745 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:08,386 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5302370728116882745 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:08,387 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5302370728116882745 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:08,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0032 dst=null perm=null
2013-10-31 16:19:09,348 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_5130222379336307247_1370 blk_-5302370728116882745_1371 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:09,349 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_5130222379336307247_1370 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:09,511 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data4/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:09,511 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data4/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:09,511 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data4/current/blk_2094033281312644685
2013-10-31 16:19:09,512 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5130222379336307247_1370 file build/test/data/dfs/data/data3/current/blk_5130222379336307247 for deletion
2013-10-31 16:19:09,512 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data4/current/blk_4073126747153669157
2013-10-31 16:19:09,512 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5130222379336307247_1370 at file build/test/data/dfs/data/data3/current/blk_5130222379336307247
2013-10-31 16:19:11,266 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0032_m_000005_0 0.0% cleanup
2013-10-31 16:19:11,267 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0032_m_000005_0 is done.
2013-10-31 16:19:11,268 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0032_m_000005_0 was -1
2013-10-31 16:19:11,268 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:12,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5302370728116882745_1371 file build/test/data/dfs/data/data8/current/blk_-5302370728116882745 for deletion
2013-10-31 16:19:12,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data8/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:12,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5302370728116882745_1371 at file build/test/data/dfs/data/data8/current/blk_-5302370728116882745
2013-10-31 16:19:12,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data7/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:12,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data8/current/blk_2094033281312644685
2013-10-31 16:19:12,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5130222379336307247_1370 file build/test/data/dfs/data/data7/current/blk_5130222379336307247 for deletion
2013-10-31 16:19:12,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data7/current/blk_4073126747153669157
2013-10-31 16:19:12,124 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5130222379336307247_1370 at file build/test/data/dfs/data/data7/current/blk_5130222379336307247
2013-10-31 16:19:12,349 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_5130222379336307247_1370 blk_-5302370728116882745_1371 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:12,349 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5302370728116882745_1371 blk_4073126747153669157_1368 blk_2094033281312644685_1369
2013-10-31 16:19:12,897 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0032_m_000005_0' has completed task_20131031160444934_0032_m_000005 successfully.
2013-10-31 16:19:12,898 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0032 has completed successfully.
2013-10-31 16:19:12,898 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0032,submitTime=1383236325095,launchTime=1383236325217,firstMapTaskLaunchTime=1383236331908,firstJobSetupTaskLaunchTime=1383236325851,firstJobCleanupTaskLaunchTime=1383236346887,finishTime=1383236352898,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[00C6855187034102BD14C2CB0C62BC51/A7F8D74902DE4FF6A54887383F7C0872] lower*upper/(1/1) ...edpipesplatform/joininner
2013-10-31 16:19:12,903 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6. blk_-1306360006653944798_1380
2013-10-31 16:19:12,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1306360006653944798_1380 src: /127.0.0.1:56582 dest: /127.0.0.1:41648
2013-10-31 16:19:12,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1306360006653944798_1380 src: /127.0.0.1:36547 dest: /127.0.0.1:38271
2013-10-31 16:19:12,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1306360006653944798_1380 src: /127.0.0.1:36479 dest: /127.0.0.1:50942
2013-10-31 16:19:12,921 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36479, dest: /127.0.0.1:50942, bytes: 25792, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1306360006653944798_1380, duration: 5823843
2013-10-31 16:19:12,922 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1306360006653944798_1380 terminating
2013-10-31 16:19:12,922 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1306360006653944798_1380 size 25792
2013-10-31 16:19:12,922 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36547, dest: /127.0.0.1:38271, bytes: 25792, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1306360006653944798_1380, duration: 5501042
2013-10-31 16:19:12,923 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1306360006653944798_1380 size 25792
2013-10-31 16:19:12,923 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1306360006653944798_1380 terminating
2013-10-31 16:19:12,923 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56582, dest: /127.0.0.1:41648, bytes: 25792, op: HDFS_WRITE, cliID: DFSClient_-519505853, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1306360006653944798_1380, duration: 4425234
2013-10-31 16:19:12,924 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1306360006653944798_1380 terminating
2013-10-31 16:19:12,930 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1306360006653944798_1380 size 25792
2013-10-31 16:19:12,930 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6 from client DFSClient_-519505853
2013-10-31 16:19:12,930 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_logs/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6 is closed by DFSClient_-519505853
2013-10-31 16:19:12,939 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0032_1383236325095_hadoop_%5B00C6855187034102BD14C2CB0C62BC51%2FA7F8D74902DE4FF6 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:12,940 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000004_0'
2013-10-31 16:19:12,941 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000005_0'
2013-10-31 16:19:12,942 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000000_0'
2013-10-31 16:19:12,942 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1424133611784958048 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:12,942 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000001_0'
2013-10-31 16:19:12,943 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1424133611784958048 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:12,943 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000006_0'
2013-10-31 16:19:12,943 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1424133611784958048 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:12,945 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0032_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:12,950 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/_temporary
2013-10-31 16:19:12,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0032 dst=null perm=null
2013-10-31 16:19:12,971 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000002_0'
2013-10-31 16:19:12,972 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0032_m_000003_0'
2013-10-31 16:19:13,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=null
2013-10-31 16:19:13,009 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:19:13,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2013-10-31 16:19:13,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2013-10-31 16:19:13,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2013-10-31 16:19:13,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2013-10-31 16:19:13,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2013-10-31 16:19:13,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2013-10-31 16:19:13,022 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56586, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7773255689976018768_1376, duration: 283836
2013-10-31 16:19:13,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2013-10-31 16:19:13,026 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36482, bytes: 34, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5905163722231129390_1375, duration: 257543
2013-10-31 16:19:13,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2013-10-31 16:19:13,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2013-10-31 16:19:13,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2013-10-31 16:19:13,032 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56588, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-223779029298134025_1379, duration: 261917
2013-10-31 16:19:13,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=null
2013-10-31 16:19:13,050 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:19:13,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2013-10-31 16:19:13,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2013-10-31 16:19:13,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2013-10-31 16:19:13,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2013-10-31 16:19:13,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2013-10-31 16:19:13,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2013-10-31 16:19:13,059 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56589, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7773255689976018768_1376, duration: 255498
2013-10-31 16:19:13,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2013-10-31 16:19:13,063 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56590, bytes: 34, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5905163722231129390_1375, duration: 253396
2013-10-31 16:19:13,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2013-10-31 16:19:13,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2013-10-31 16:19:13,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2013-10-31 16:19:13,069 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56591, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-223779029298134025_1379, duration: 262037
2013-10-31 16:19:13,069 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joininner
2013-10-31 16:19:13,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner dst=null perm=null
2013-10-31 16:19:13,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2013-10-31 16:19:13,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36487, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7773255689976018768_1376, duration: 254389
2013-10-31 16:19:13,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2013-10-31 16:19:13,082 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36488, bytes: 34, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5905163722231129390_1375, duration: 259799
2013-10-31 16:19:13,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2013-10-31 16:19:13,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2013-10-31 16:19:13,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2013-10-31 16:19:13,091 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36489, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-223779029298134025_1379, duration: 305689
2013-10-31 16:19:13,111 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:19:13,112 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:19:13,128 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5302370728116882745_1371 file build/test/data/dfs/data/data6/current/blk_-5302370728116882745 for deletion
2013-10-31 16:19:13,128 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data6/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:13,128 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data5/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:13,129 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5302370728116882745_1371 at file build/test/data/dfs/data/data6/current/blk_-5302370728116882745
2013-10-31 16:19:13,129 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5130222379336307247_1370 file build/test/data/dfs/data/data5/current/blk_5130222379336307247 for deletion
2013-10-31 16:19:13,129 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data5/current/blk_4073126747153669157
2013-10-31 16:19:13,129 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data6/current/blk_2094033281312644685
2013-10-31 16:19:13,129 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5130222379336307247_1370 at file build/test/data/dfs/data/data5/current/blk_5130222379336307247
2013-10-31 16:19:13,136 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] starting
2013-10-31 16:19:13,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:19:13,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby"]
2013-10-31 16:19:13,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] parallel execution is enabled: true
2013-10-31 16:19:13,138 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] starting jobs: 2
2013-10-31 16:19:13,138 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs*rhs] allocating threads: 2
2013-10-31 16:19:13,139 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] starting step: (2/2)
2013-10-31 16:19:13,143 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:19:13,143 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:19:13,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:13,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:19:13,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:13,164 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar. blk_-453853160008994316_1381
2013-10-31 16:19:13,165 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:36490 dest: /127.0.0.1:50942
2013-10-31 16:19:13,166 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:56596 dest: /127.0.0.1:41648
2013-10-31 16:19:13,168 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:49594 dest: /127.0.0.1:47311
2013-10-31 16:19:13,176 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49594, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-453853160008994316_1381, duration: 3717889
2013-10-31 16:19:13,176 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-453853160008994316_1381 terminating
2013-10-31 16:19:13,177 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56596, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-453853160008994316_1381, duration: 4531075
2013-10-31 16:19:13,177 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-453853160008994316_1381 terminating
2013-10-31 16:19:13,178 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36490, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-453853160008994316_1381, duration: 5708946
2013-10-31 16:19:13,178 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-453853160008994316_1381 terminating
2013-10-31 16:19:13,180 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:13,180 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar from client DFSClient_1457307213
2013-10-31 16:19:13,180 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar is closed by DFSClient_1457307213
2013-10-31 16:19:13,181 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:13,181 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:13,187 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar. New replication is 10
2013-10-31 16:19:14,913 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5302370728116882745_1371 file build/test/data/dfs/data/data2/current/blk_-5302370728116882745 for deletion
2013-10-31 16:19:14,913 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2094033281312644685_1369 file build/test/data/dfs/data/data1/current/blk_2094033281312644685 for deletion
2013-10-31 16:19:14,913 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5302370728116882745_1371 at file build/test/data/dfs/data/data2/current/blk_-5302370728116882745
2013-10-31 16:19:14,914 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2094033281312644685_1369 at file build/test/data/dfs/data/data1/current/blk_2094033281312644685
2013-10-31 16:19:14,913 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4073126747153669157_1368 file build/test/data/dfs/data/data2/current/blk_4073126747153669157 for deletion
2013-10-31 16:19:14,915 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4073126747153669157_1368 at file build/test/data/dfs/data/data2/current/blk_4073126747153669157
2013-10-31 16:19:15,350 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-453853160008994316_1381 to datanode(s) 127.0.0.1:38271
2013-10-31 16:19:15,351 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_1424133611784958048_1374
2013-10-31 16:19:15,351 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_1424133611784958048_1374
2013-10-31 16:19:15,513 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1424133611784958048_1374 file build/test/data/dfs/data/data3/current/blk_1424133611784958048 for deletion
2013-10-31 16:19:15,513 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1424133611784958048_1374 at file build/test/data/dfs/data/data3/current/blk_1424133611784958048
2013-10-31 16:19:15,893 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:15,894 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0032 being deleted.
2013-10-31 16:19:16,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar dst=null perm=null
2013-10-31 16:19:16,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,531 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:19:16,536 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:19:16,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:19:16,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,551 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split. New replication is 10
2013-10-31 16:19:16,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=null
2013-10-31 16:19:16,560 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split. blk_777667023145340875_1382
2013-10-31 16:19:16,562 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:36493 dest: /127.0.0.1:50942
2013-10-31 16:19:16,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:36563 dest: /127.0.0.1:38271
2013-10-31 16:19:16,566 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:49597 dest: /127.0.0.1:47311
2013-10-31 16:19:16,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_777667023145340875_1382 src: /127.0.0.1:56601 dest: /127.0.0.1:41648
2013-10-31 16:19:16,571 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56601, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777667023145340875_1382, duration: 228981
2013-10-31 16:19:16,571 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,571 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,572 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49597, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_777667023145340875_1382, duration: 1046494
2013-10-31 16:19:16,572 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,573 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,573 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36563, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 2580609
2013-10-31 16:19:16,574 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,574 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36493, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777667023145340875_1382, duration: 3401237
2013-10-31 16:19:16,575 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_777667023145340875_1382 terminating
2013-10-31 16:19:16,576 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,576 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split from client DFSClient_1457307213
2013-10-31 16:19:16,577 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split is closed by DFSClient_1457307213
2013-10-31 16:19:16,577 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_777667023145340875_1382 size 1732
2013-10-31 16:19:16,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,604 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo. blk_1600864550067754613_1383
2013-10-31 16:19:16,606 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1600864550067754613_1383 src: /127.0.0.1:36497 dest: /127.0.0.1:50942
2013-10-31 16:19:16,608 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1600864550067754613_1383 src: /127.0.0.1:36567 dest: /127.0.0.1:38271
2013-10-31 16:19:16,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1600864550067754613_1383 src: /127.0.0.1:56604 dest: /127.0.0.1:41648
2013-10-31 16:19:16,612 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56604, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1600864550067754613_1383, duration: 80176
2013-10-31 16:19:16,613 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1600864550067754613_1383 terminating
2013-10-31 16:19:16,613 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36567, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1600864550067754613_1383, duration: 1174563
2013-10-31 16:19:16,614 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1600864550067754613_1383 terminating
2013-10-31 16:19:16,614 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36497, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1600864550067754613_1383, duration: 1986509
2013-10-31 16:19:16,615 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1600864550067754613_1383 size 183
2013-10-31 16:19:16,615 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1600864550067754613_1383 terminating
2013-10-31 16:19:16,617 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1600864550067754613_1383 size 183
2013-10-31 16:19:16,617 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:19:16,618 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:19:16,618 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1600864550067754613_1383 size 183
2013-10-31 16:19:16,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,651 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml. blk_-7933150028582980354_1384
2013-10-31 16:19:16,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7933150028582980354_1384 src: /127.0.0.1:36500 dest: /127.0.0.1:50942
2013-10-31 16:19:16,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7933150028582980354_1384 src: /127.0.0.1:36570 dest: /127.0.0.1:38271
2013-10-31 16:19:16,656 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7933150028582980354_1384 src: /127.0.0.1:56607 dest: /127.0.0.1:41648
2013-10-31 16:19:16,659 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56607, dest: /127.0.0.1:41648, bytes: 28207, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7933150028582980354_1384, duration: 174226
2013-10-31 16:19:16,659 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7933150028582980354_1384 terminating
2013-10-31 16:19:16,660 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36570, dest: /127.0.0.1:38271, bytes: 28207, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7933150028582980354_1384, duration: 1033470
2013-10-31 16:19:16,660 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7933150028582980354_1384 terminating
2013-10-31 16:19:16,660 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7933150028582980354_1384 size 28207
2013-10-31 16:19:16,660 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36500, dest: /127.0.0.1:50942, bytes: 28207, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7933150028582980354_1384, duration: 1890890
2013-10-31 16:19:16,661 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7933150028582980354_1384 terminating
2013-10-31 16:19:16,661 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7933150028582980354_1384 size 28207
2013-10-31 16:19:16,663 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml from client DFSClient_1457307213
2013-10-31 16:19:16,663 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml is closed by DFSClient_1457307213
2013-10-31 16:19:16,663 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7933150028582980354_1384 size 28207
2013-10-31 16:19:16,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml dst=null perm=null
2013-10-31 16:19:16,679 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36504, bytes: 28431, op: HDFS_READ, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7933150028582980354_1384, duration: 398415
2013-10-31 16:19:16,698 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0033: nMaps=5 nReduces=1 max=-1
2013-10-31 16:19:16,698 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0033 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:19:16,698 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0033 RESULT=SUCCESS
2013-10-31 16:19:16,698 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0033
2013-10-31 16:19:16,699 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0033
2013-10-31 16:19:16,699 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] submitted hadoop job: job_20131031160444934_0033
2013-10-31 16:19:16,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,730 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml. blk_-499582711603059738_1386
2013-10-31 16:19:16,732 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-499582711603059738_1386 src: /127.0.0.1:49607 dest: /127.0.0.1:47311
2013-10-31 16:19:16,733 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-499582711603059738_1386 src: /127.0.0.1:56611 dest: /127.0.0.1:41648
2013-10-31 16:19:16,735 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-499582711603059738_1386 src: /127.0.0.1:36507 dest: /127.0.0.1:50942
2013-10-31 16:19:16,739 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36507, dest: /127.0.0.1:50942, bytes: 28272, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-499582711603059738_1386, duration: 601056
2013-10-31 16:19:16,740 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-499582711603059738_1386 terminating
2013-10-31 16:19:16,740 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56611, dest: /127.0.0.1:41648, bytes: 28272, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-499582711603059738_1386, duration: 1421807
2013-10-31 16:19:16,741 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-499582711603059738_1386 terminating
2013-10-31 16:19:16,741 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-499582711603059738_1386 size 28272
2013-10-31 16:19:16,741 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49607, dest: /127.0.0.1:47311, bytes: 28272, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-499582711603059738_1386, duration: 2380050
2013-10-31 16:19:16,742 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-499582711603059738_1386 terminating
2013-10-31 16:19:16,742 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-499582711603059738_1386 size 28272
2013-10-31 16:19:16,744 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml from client DFSClient_1812894713
2013-10-31 16:19:16,744 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_conf.xml is closed by DFSClient_1812894713
2013-10-31 16:19:16,745 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-499582711603059738_1386 size 28272
2013-10-31 16:19:16,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:16,757 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken. blk_3881077061080299198_1387
2013-10-31 16:19:16,759 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3881077061080299198_1387 src: /127.0.0.1:36508 dest: /127.0.0.1:50942
2013-10-31 16:19:16,760 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3881077061080299198_1387 src: /127.0.0.1:36578 dest: /127.0.0.1:38271
2013-10-31 16:19:16,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3881077061080299198_1387 src: /127.0.0.1:56615 dest: /127.0.0.1:41648
2013-10-31 16:19:16,765 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56615, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3881077061080299198_1387, duration: 64891
2013-10-31 16:19:16,765 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3881077061080299198_1387 terminating
2013-10-31 16:19:16,766 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36578, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3881077061080299198_1387, duration: 777958
2013-10-31 16:19:16,766 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3881077061080299198_1387 terminating
2013-10-31 16:19:16,767 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3881077061080299198_1387 size 116
2013-10-31 16:19:16,767 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36508, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3881077061080299198_1387, duration: 1718404
2013-10-31 16:19:16,767 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3881077061080299198_1387 terminating
2013-10-31 16:19:16,769 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken from client DFSClient_1457307213
2013-10-31 16:19:16,769 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken is closed by DFSClient_1457307213
2013-10-31 16:19:16,770 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3881077061080299198_1387 size 116
2013-10-31 16:19:16,771 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3881077061080299198_1387 size 116
2013-10-31 16:19:16,775 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken
2013-10-31 16:19:16,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.splitmetainfo dst=null perm=null
2013-10-31 16:19:16,779 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56616, bytes: 187, op: HDFS_READ, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1600864550067754613_1383, duration: 272282
2013-10-31 16:19:16,780 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0033 = 19. Number of splits = 5
2013-10-31 16:19:16,781 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,781 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,781 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,781 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,782 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,783 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0033_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:16,784 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0033 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:19:16,785 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0033 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:19:17,942 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:17,943 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000004_0 not found in cache
2013-10-31 16:19:17,943 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000005_0 not found in cache
2013-10-31 16:19:17,944 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0032 for user-log deletion with retainTimeStamp:1383322757943
2013-10-31 16:19:17,972 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:17,972 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000001_0 not found in cache
2013-10-31 16:19:17,972 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000000_0 not found in cache
2013-10-31 16:19:17,973 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0032 for user-log deletion with retainTimeStamp:1383322757973
2013-10-31 16:19:18,011 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0032
2013-10-31 16:19:18,011 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000003_0 not found in cache
2013-10-31 16:19:18,012 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0032_m_000002_0 not found in cache
2013-10-31 16:19:18,012 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0032 for user-log deletion with retainTimeStamp:1383322758012
2013-10-31 16:19:18,125 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-453853160008994316_1381 to 127.0.0.1:38271
2013-10-31 16:19:18,125 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1424133611784958048_1374 file build/test/data/dfs/data/data8/current/blk_1424133611784958048 for deletion
2013-10-31 16:19:18,126 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1424133611784958048_1374 at file build/test/data/dfs/data/data8/current/blk_1424133611784958048
2013-10-31 16:19:18,127 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-453853160008994316_1381 src: /127.0.0.1:36581 dest: /127.0.0.1:38271
2013-10-31 16:19:18,127 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-453853160008994316_1381 to /127.0.0.1:38271
2013-10-31 16:19:18,130 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-453853160008994316_1381 src: /127.0.0.1:36581 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:19:18,131 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-453853160008994316_1381 size 238055
2013-10-31 16:19:18,340 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_1107410354 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,351 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30496 with signal TERM. Exit code 0
2013-10-31 16:19:18,351 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_1424133611784958048_1374
2013-10-31 16:19:18,423 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_2061442510 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,432 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30317 with signal TERM. Exit code 0
2013-10-31 16:19:18,477 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_-1891823038 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,484 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30347 with signal TERM. Exit code 0
2013-10-31 16:19:18,512 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:18,512 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:18,512 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:18,512 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_1107410354 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:18,552 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_915869845 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:18,556 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30093 with signal TERM. Exit code 0
2013-10-31 16:19:18,898 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0033_m_000006_0' to tip task_20131031160444934_0033_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:18,903 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:19:18,904 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000006_0 which needs 1 slots
2013-10-31 16:19:18,904 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000006_0 which needs 1 slots
2013-10-31 16:19:18,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken dst=null perm=null
2013-10-31 16:19:18,920 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36513, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3881077061080299198_1387, duration: 293620
2013-10-31 16:19:18,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml dst=null perm=null
2013-10-31 16:19:18,930 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36584, bytes: 28431, op: HDFS_READ, cliID: DFSClient_-1445678719, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7933150028582980354_1384, duration: 382701
2013-10-31 16:19:19,107 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:19,130 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1424133611784958048_1374 file build/test/data/dfs/data/data5/current/blk_1424133611784958048 for deletion
2013-10-31 16:19:19,130 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,130 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,130 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,131 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,131 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:19,131 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,131 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_-1891823038 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:19,131 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:19,130 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,131 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:19,130 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1424133611784958048_1374 at file build/test/data/dfs/data/data5/current/blk_1424133611784958048
2013-10-31 16:19:19,132 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_915869845 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:19:19,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar dst=null perm=null
2013-10-31 16:19:19,131 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_2061442510 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:19,134 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36516, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1445678719, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-453853160008994316_1381, duration: 598998
2013-10-31 16:19:19,214 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-1126263002
2013-10-31 16:19:19,215 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-1126263002 spawned.
2013-10-31 16:19:19,216 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000006_0/taskjvm.sh
2013-10-31 16:19:19,330 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_1898439609 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:19,340 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30588 with signal TERM. Exit code 0
2013-10-31 16:19:19,460 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0032_m_-307560193 since job job_20131031160444934_0032 is dead
2013-10-31 16:19:19,464 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30266 with signal TERM. Exit code 0
2013-10-31 16:19:19,504 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,504 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,504 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:19,504 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_1898439609 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:19,620 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:19,620 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:19,620 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:19,620 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0032_m_-307560193 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:21,534 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1126263002 given task: attempt_20131031160444934_0033_m_000006_0
2013-10-31 16:19:22,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:25,009 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000006_0 0.0% setup
2013-10-31 16:19:25,012 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000006_0 is done.
2013-10-31 16:19:25,012 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000006_0 was -1
2013-10-31 16:19:25,012 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:27,914 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000006_0' has completed task_20131031160444934_0033_m_000006 successfully.
2013-10-31 16:19:27,918 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000000_0' to tip task_20131031160444934_0033_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:27,919 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000000
2013-10-31 16:19:27,920 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000001_0' to tip task_20131031160444934_0033_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:27,920 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000001
2013-10-31 16:19:27,922 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:19:27,923 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:19:27,924 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000000_0 which needs 1 slots
2013-10-31 16:19:27,924 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000000_0 which needs 1 slots
2013-10-31 16:19:27,924 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000001_0 which needs 1 slots
2013-10-31 16:19:27,924 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0033_m_000001_0 which needs 1 slots
2013-10-31 16:19:27,958 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000002_0' to tip task_20131031160444934_0033_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:27,958 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000002
2013-10-31 16:19:27,958 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000003_0' to tip task_20131031160444934_0033_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:27,959 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000003
2013-10-31 16:19:27,960 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:19:27,960 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:19:27,960 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000002_0 which needs 1 slots
2013-10-31 16:19:27,960 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000002_0 which needs 1 slots
2013-10-31 16:19:27,960 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000003_0 which needs 1 slots
2013-10-31 16:19:27,961 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0033_m_000003_0 which needs 1 slots
2013-10-31 16:19:27,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken dst=null perm=null
2013-10-31 16:19:27,966 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-1857432135
2013-10-31 16:19:27,967 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-1857432135 spawned.
2013-10-31 16:19:27,968 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36588, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3881077061080299198_1387, duration: 303982
2013-10-31 16:19:27,968 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000000_0/taskjvm.sh
2013-10-31 16:19:27,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml dst=null perm=null
2013-10-31 16:19:27,976 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56626, bytes: 28431, op: HDFS_READ, cliID: DFSClient_1653635854, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7933150028582980354_1384, duration: 185654
2013-10-31 16:19:27,983 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0033/attempt_20131031160444934_0033_m_000001_0. Attempting to reuse: jvm_20131031160444934_0033_m_-1126263002
2013-10-31 16:19:27,988 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0033_m_000004_0' to tip task_20131031160444934_0033_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:19:27,988 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0033_m_000004
2013-10-31 16:19:27,989 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:27,989 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:19:27,990 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000004_0 which needs 1 slots
2013-10-31 16:19:27,990 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000004_0 which needs 1 slots
2013-10-31 16:19:27,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033/jobToken dst=null perm=null
2013-10-31 16:19:27,997 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56627, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3881077061080299198_1387, duration: 270959
2013-10-31 16:19:28,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar dst=null perm=null
2013-10-31 16:19:28,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.xml dst=null perm=null
2013-10-31 16:19:28,007 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36524, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1653635854, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-453853160008994316_1381, duration: 650898
2013-10-31 16:19:28,009 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36525, bytes: 28431, op: HDFS_READ, cliID: DFSClient_-1227566731, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7933150028582980354_1384, duration: 377501
2013-10-31 16:19:28,032 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:28,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.jar dst=null perm=null
2013-10-31 16:19:28,048 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56631, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1227566731, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-453853160008994316_1381, duration: 598242
2013-10-31 16:19:28,059 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-357406308
2013-10-31 16:19:28,060 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-357406308 spawned.
2013-10-31 16:19:28,060 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_-426699948
2013-10-31 16:19:28,061 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_-426699948 spawned.
2013-10-31 16:19:28,062 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000002_0/taskjvm.sh
2013-10-31 16:19:28,062 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000003_0/taskjvm.sh
2013-10-31 16:19:28,406 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_m_824648574
2013-10-31 16:19:28,406 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_m_824648574 spawned.
2013-10-31 16:19:28,407 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_m_000004_0/taskjvm.sh
2013-10-31 16:19:28,579 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1126263002 given task: attempt_20131031160444934_0033_m_000001_0
2013-10-31 16:19:28,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=null
2013-10-31 16:19:28,762 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36598, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 167230
2013-10-31 16:19:28,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:19:28,805 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36530, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 264515
2013-10-31 16:19:28,808 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1857432135 given task: attempt_20131031160444934_0033_m_000000_0
2013-10-31 16:19:29,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=null
2013-10-31 16:19:29,347 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36602, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 174703
2013-10-31 16:19:29,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:19:29,440 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-357406308 given task: attempt_20131031160444934_0033_m_000002_0
2013-10-31 16:19:29,604 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_824648574 given task: attempt_20131031160444934_0033_m_000004_0
2013-10-31 16:19:29,619 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-426699948 given task: attempt_20131031160444934_0033_m_000003_0
2013-10-31 16:19:29,661 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49638, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 128932
2013-10-31 16:19:29,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=null
2013-10-31 16:19:29,971 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36607, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_777667023145340875_1382, duration: 161946
2013-10-31 16:19:30,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:19:30,011 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49641, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 258419
2013-10-31 16:19:30,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=null
2013-10-31 16:19:30,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033/job.split dst=null perm=null
2013-10-31 16:19:30,120 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36542, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_777667023145340875_1382, duration: 170149
2013-10-31 16:19:30,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56648, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_777667023145340875_1382, duration: 166468
2013-10-31 16:19:30,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:19:30,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:19:30,160 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36613, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 131601
2013-10-31 16:19:30,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49647, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0033_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 98100
2013-10-31 16:19:31,727 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:19:31,730 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000001_0 is done.
2013-10-31 16:19:31,731 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000001_0 was 23
2013-10-31 16:19:31,731 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:19:32,274 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:19:32,277 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000000_0 is done.
2013-10-31 16:19:32,277 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000000_0 was 23
2013-10-31 16:19:32,278 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:32,900 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:19:32,903 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000002_0 is done.
2013-10-31 16:19:32,903 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000002_0 was 23
2013-10-31 16:19:32,903 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:19:32,924 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0033_m_000006_0
2013-10-31 16:19:32,924 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0033_m_000006_0
2013-10-31 16:19:32,924 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0033_m_000006_0 not found in cache
2013-10-31 16:19:33,049 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:19:33,051 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:19:33,052 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000004_0 is done.
2013-10-31 16:19:33,053 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000004_0 was 23
2013-10-31 16:19:33,053 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:33,054 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000003_0 is done.
2013-10-31 16:19:33,054 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000003_0 was 23
2013-10-31 16:19:33,054 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:33,930 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000000_0' has completed task_20131031160444934_0033_m_000000 successfully.
2013-10-31 16:19:33,985 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000001_0' has completed task_20131031160444934_0033_m_000001 successfully.
2013-10-31 16:19:33,987 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0033_r_000000_0' to tip task_20131031160444934_0033_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:33,988 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000002_0' has completed task_20131031160444934_0033_m_000002 successfully.
2013-10-31 16:19:33,989 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:19:33,990 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_r_000000_0 which needs 1 slots
2013-10-31 16:19:33,990 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_r_000000_0 which needs 1 slots
2013-10-31 16:19:33,990 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000003_0' has completed task_20131031160444934_0033_m_000003 successfully.
2013-10-31 16:19:33,997 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000004_0' has completed task_20131031160444934_0033_m_000004 successfully.
2013-10-31 16:19:34,028 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0033_r_-710893147
2013-10-31 16:19:34,029 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0033_r_-710893147 spawned.
2013-10-31 16:19:34,032 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0033/attempt_20131031160444934_0033_r_000000_0/taskjvm.sh
2013-10-31 16:19:34,945 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_r_-710893147 given task: attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:39,847 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:19:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,875 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,880 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,886 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,891 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:19:39,891 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:19:40,621 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44479, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000000_0, duration: 6027347
2013-10-31 16:19:40,636 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:43403, dest: 10.5.128.102:44479, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000001_0, duration: 9540176
2013-10-31 16:19:40,651 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60278, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000002_0, duration: 10219769
2013-10-31 16:19:40,666 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60278, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000003_0, duration: 11205550
2013-10-31 16:19:40,682 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48347, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0033_m_000004_0, duration: 11638366
2013-10-31 16:19:41,437 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:41,482 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:41,540 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:41,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:41,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:41,791 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000. blk_6547866045732676229_1388
2013-10-31 16:19:41,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6547866045732676229_1388 src: /127.0.0.1:56660 dest: /127.0.0.1:41648
2013-10-31 16:19:41,834 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6547866045732676229_1388 src: /127.0.0.1:36556 dest: /127.0.0.1:50942
2013-10-31 16:19:41,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6547866045732676229_1388 src: /127.0.0.1:36626 dest: /127.0.0.1:38271
2013-10-31 16:19:41,838 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36626, dest: /127.0.0.1:38271, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0033_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6547866045732676229_1388, duration: 1447582
2013-10-31 16:19:41,839 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6547866045732676229_1388 terminating
2013-10-31 16:19:41,839 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36556, dest: /127.0.0.1:50942, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0033_r_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6547866045732676229_1388, duration: 2591590
2013-10-31 16:19:41,839 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6547866045732676229_1388 terminating
2013-10-31 16:19:41,839 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56660, dest: /127.0.0.1:41648, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0033_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6547866045732676229_1388, duration: 3038491
2013-10-31 16:19:41,839 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6547866045732676229_1388 terminating
2013-10-31 16:19:41,841 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6547866045732676229_1388 size 180
2013-10-31 16:19:41,842 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:41,842 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:41,842 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6547866045732676229_1388 size 180
2013-10-31 16:19:41,843 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6547866045732676229_1388 size 180
2013-10-31 16:19:41,877 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0033_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:19:41,878 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:19:42,998 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0033_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:55789
2013-10-31 16:19:42,999 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:43,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0 dst=null perm=null
2013-10-31 16:19:43,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:43,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:43,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary/_attempt_20131031160444934_0033_r_000000_0 dst=null perm=null
2013-10-31 16:19:44,486 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 16:19:44,488 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 16:19:44,489 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_r_000000_0 is done.
2013-10-31 16:19:44,489 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_r_000000_0 was -1
2013-10-31 16:19:44,490 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:46,003 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_r_000000_0' has completed task_20131031160444934_0033_r_000000 successfully.
2013-10-31 16:19:46,018 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0033_m_000005_0' to tip task_20131031160444934_0033_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:19:46,021 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0033_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:19:46,021 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0033_m_000005_0 which needs 1 slots
2013-10-31 16:19:46,021 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0033_m_000005_0 which needs 1 slots
2013-10-31 16:19:46,054 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0033/attempt_20131031160444934_0033_m_000005_0. Attempting to reuse: jvm_20131031160444934_0033_m_-1126263002
2013-10-31 16:19:47,280 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0033_m_-1126263002 given task: attempt_20131031160444934_0033_m_000005_0
2013-10-31 16:19:47,389 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000005_0 0.0%
2013-10-31 16:19:47,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_temporary dst=null perm=null
2013-10-31 16:19:47,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:47,411 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_SUCCESS from client DFSClient_attempt_20131031160444934_0033_m_000005_0
2013-10-31 16:19:47,411 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0033_m_000005_0
2013-10-31 16:19:47,415 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,416 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:47,416 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,416 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-453853160008994316 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,416 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,416 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:19:47,416 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_777667023145340875 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1600864550067754613 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1600864550067754613 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1600864550067754613 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7933150028582980354 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:47,417 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7933150028582980354 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:47,418 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7933150028582980354 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:47,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0033 dst=null perm=null
2013-10-31 16:19:48,356 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_777667023145340875_1382 blk_-7933150028582980354_1384 blk_-453853160008994316_1381 blk_1600864550067754613_1383
2013-10-31 16:19:48,357 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_777667023145340875_1382 blk_-7933150028582980354_1384 blk_-453853160008994316_1381 blk_1600864550067754613_1383
2013-10-31 16:19:50,364 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0033_m_000005_0 0.0% cleanup
2013-10-31 16:19:50,365 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0033_m_000005_0 is done.
2013-10-31 16:19:50,366 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0033_m_000005_0 was -1
2013-10-31 16:19:50,366 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:19:50,925 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7933150028582980354_1384 file build/test/data/dfs/data/data1/current/blk_-7933150028582980354 for deletion
2013-10-31 16:19:50,925 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data1/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:50,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7933150028582980354_1384 at file build/test/data/dfs/data/data1/current/blk_-7933150028582980354
2013-10-31 16:19:50,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data1/current/blk_777667023145340875 for deletion
2013-10-31 16:19:50,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data1/current/blk_-453853160008994316
2013-10-31 16:19:50,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1600864550067754613_1383 file build/test/data/dfs/data/data2/current/blk_1600864550067754613 for deletion
2013-10-31 16:19:50,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data1/current/blk_777667023145340875
2013-10-31 16:19:50,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1600864550067754613_1383 at file build/test/data/dfs/data/data2/current/blk_1600864550067754613
2013-10-31 16:19:51,021 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:51,022 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0033_r_000000_0
2013-10-31 16:19:51,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7933150028582980354_1384 file build/test/data/dfs/data/data8/current/blk_-7933150028582980354 for deletion
2013-10-31 16:19:51,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data7/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:51,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7933150028582980354_1384 at file build/test/data/dfs/data/data8/current/blk_-7933150028582980354
2013-10-31 16:19:51,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data8/current/blk_777667023145340875 for deletion
2013-10-31 16:19:51,136 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data7/current/blk_-453853160008994316
2013-10-31 16:19:51,136 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data8/current/blk_777667023145340875
2013-10-31 16:19:51,136 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1600864550067754613_1383 file build/test/data/dfs/data/data7/current/blk_1600864550067754613 for deletion
2013-10-31 16:19:51,136 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1600864550067754613_1383 at file build/test/data/dfs/data/data7/current/blk_1600864550067754613
2013-10-31 16:19:51,357 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_777667023145340875_1382 blk_-7933150028582980354_1384 blk_-453853160008994316_1381 blk_1600864550067754613_1383
2013-10-31 16:19:51,358 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_777667023145340875_1382 blk_-453853160008994316_1381
2013-10-31 16:19:51,525 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data4/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:51,525 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data3/current/blk_777667023145340875 for deletion
2013-10-31 16:19:51,526 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data4/current/blk_-453853160008994316
2013-10-31 16:19:51,526 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data3/current/blk_777667023145340875
2013-10-31 16:19:52,030 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0033_m_000005_0' has completed task_20131031160444934_0033_m_000005 successfully.
2013-10-31 16:19:52,031 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0033 has completed successfully.
2013-10-31 16:19:52,031 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0033,submitTime=1383236356670,launchTime=1383236356784,firstMapTaskLaunchTime=1383236367918,firstReduceTaskLaunchTime=1383236373986,firstJobSetupTaskLaunchTime=1383236358897,firstJobCleanupTaskLaunchTime=1383236386018,finishTime=1383236392031,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1686E7C7AC8C482C92D85BC9B258DF0C/FD555B8F6C784F1D9145DCB3DE82E908] lhs*rhs/(2/2)
2013-10-31 16:19:52,035 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D. blk_-4238039309339233228_1389
2013-10-31 16:19:52,040 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4238039309339233228_1389 src: /127.0.0.1:56665 dest: /127.0.0.1:41648
2013-10-31 16:19:52,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4238039309339233228_1389 src: /127.0.0.1:49663 dest: /127.0.0.1:47311
2013-10-31 16:19:52,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4238039309339233228_1389 src: /127.0.0.1:36631 dest: /127.0.0.1:38271
2013-10-31 16:19:52,053 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36631, dest: /127.0.0.1:38271, bytes: 31961, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4238039309339233228_1389, duration: 2241053
2013-10-31 16:19:52,054 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4238039309339233228_1389 terminating
2013-10-31 16:19:52,054 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4238039309339233228_1389 size 31961
2013-10-31 16:19:52,054 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49663, dest: /127.0.0.1:47311, bytes: 31961, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4238039309339233228_1389, duration: 3998942
2013-10-31 16:19:52,055 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4238039309339233228_1389 terminating
2013-10-31 16:19:52,055 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56665, dest: /127.0.0.1:41648, bytes: 31961, op: HDFS_WRITE, cliID: DFSClient_1812894713, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4238039309339233228_1389, duration: 5079672
2013-10-31 16:19:52,056 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4238039309339233228_1389 terminating
2013-10-31 16:19:52,059 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4238039309339233228_1389 size 31961
2013-10-31 16:19:52,059 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D from client DFSClient_1812894713
2013-10-31 16:19:52,060 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/_logs/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D is closed by DFSClient_1812894713
2013-10-31 16:19:52,060 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4238039309339233228_1389 size 31961
2013-10-31 16:19:52,069 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0033_1383236356670_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FFD555B8F6C784F1D to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:52,070 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000000_0'
2013-10-31 16:19:52,070 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000001_0'
2013-10-31 16:19:52,071 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000005_0'
2013-10-31 16:19:52,072 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000006_0'
2013-10-31 16:19:52,072 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_r_000000_0'
2013-10-31 16:19:52,073 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000004_0'
2013-10-31 16:19:52,075 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0033_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:19:52,077 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] starting step: (1/2) ...orm/samepipearoundgroupby
2013-10-31 16:19:52,079 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 16:19:52,080 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3881077061080299198 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:19:52,081 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3881077061080299198 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:19:52,081 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3881077061080299198 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:19:52,083 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:19:52,084 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:19:52,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0033 dst=null perm=null
2013-10-31 16:19:52,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:52,127 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:19:52,127 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0033 being deleted.
2013-10-31 16:19:52,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:19:52,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,141 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7933150028582980354_1384 file build/test/data/dfs/data/data5/current/blk_-7933150028582980354 for deletion
2013-10-31 16:19:52,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-453853160008994316_1381 file build/test/data/dfs/data/data6/current/blk_-453853160008994316 for deletion
2013-10-31 16:19:52,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7933150028582980354_1384 at file build/test/data/dfs/data/data5/current/blk_-7933150028582980354
2013-10-31 16:19:52,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_777667023145340875_1382 file build/test/data/dfs/data/data5/current/blk_777667023145340875 for deletion
2013-10-31 16:19:52,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-453853160008994316_1381 at file build/test/data/dfs/data/data6/current/blk_-453853160008994316
2013-10-31 16:19:52,142 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_777667023145340875_1382 at file build/test/data/dfs/data/data5/current/blk_777667023145340875
2013-10-31 16:19:52,143 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1600864550067754613_1383 file build/test/data/dfs/data/data6/current/blk_1600864550067754613 for deletion
2013-10-31 16:19:52,143 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar. blk_-1839156841999928741_1390
2013-10-31 16:19:52,143 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1600864550067754613_1383 at file build/test/data/dfs/data/data6/current/blk_1600864550067754613
2013-10-31 16:19:52,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:36633 dest: /127.0.0.1:38271
2013-10-31 16:19:52,146 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:56670 dest: /127.0.0.1:41648
2013-10-31 16:19:52,147 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:49668 dest: /127.0.0.1:47311
2013-10-31 16:19:52,158 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49668, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1839156841999928741_1390, duration: 6994824
2013-10-31 16:19:52,159 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1839156841999928741_1390 terminating
2013-10-31 16:19:52,159 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56670, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1839156841999928741_1390, duration: 8069094
2013-10-31 16:19:52,160 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1839156841999928741_1390 terminating
2013-10-31 16:19:52,160 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36633, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1839156841999928741_1390, duration: 9117361
2013-10-31 16:19:52,161 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1839156841999928741_1390 terminating
2013-10-31 16:19:52,163 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:52,164 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar from client DFSClient_1457307213
2013-10-31 16:19:52,164 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar is closed by DFSClient_1457307213
2013-10-31 16:19:52,165 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:52,165 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:52,171 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar. New replication is 10
2013-10-31 16:19:52,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar dst=null perm=null
2013-10-31 16:19:52,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,184 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:19:52,189 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:19:52,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:19:52,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:52,205 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split. New replication is 10
2013-10-31 16:19:52,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=null
2013-10-31 16:19:52,215 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split. blk_-2322401317774502462_1391
2013-10-31 16:19:52,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:36636 dest: /127.0.0.1:38271
2013-10-31 16:19:52,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:36568 dest: /127.0.0.1:50942
2013-10-31 16:19:52,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:56674 dest: /127.0.0.1:41648
2013-10-31 16:19:52,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2322401317774502462_1391 src: /127.0.0.1:49672 dest: /127.0.0.1:47311
2013-10-31 16:19:52,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49672, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 115024
2013-10-31 16:19:52,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56674, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2322401317774502462_1391, duration: 947352
2013-10-31 16:19:52,226 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,226 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36568, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2322401317774502462_1391, duration: 1824079
2013-10-31 16:19:52,227 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,227 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:52,227 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36636, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2322401317774502462_1391, duration: 2765334
2013-10-31 16:19:52,228 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2322401317774502462_1391 terminating
2013-10-31 16:19:52,232 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:52,233 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split from client DFSClient_1457307213
2013-10-31 16:19:52,233 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split is closed by DFSClient_1457307213
2013-10-31 16:19:52,234 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:52,234 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2322401317774502462_1391 size 1732
2013-10-31 16:19:53,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,431 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo. blk_-5860927746139113368_1392
2013-10-31 16:19:53,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5860927746139113368_1392 src: /127.0.0.1:36640 dest: /127.0.0.1:38271
2013-10-31 16:19:53,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5860927746139113368_1392 src: /127.0.0.1:49674 dest: /127.0.0.1:47311
2013-10-31 16:19:53,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5860927746139113368_1392 src: /127.0.0.1:36573 dest: /127.0.0.1:50942
2013-10-31 16:19:53,439 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36573, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5860927746139113368_1392, duration: 192022
2013-10-31 16:19:53,440 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5860927746139113368_1392 terminating
2013-10-31 16:19:53,440 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49674, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5860927746139113368_1392, duration: 1018601
2013-10-31 16:19:53,441 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5860927746139113368_1392 terminating
2013-10-31 16:19:53,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5860927746139113368_1392 size 183
2013-10-31 16:19:53,441 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36640, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5860927746139113368_1392, duration: 1928770
2013-10-31 16:19:53,442 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5860927746139113368_1392 terminating
2013-10-31 16:19:53,444 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5860927746139113368_1392 size 183
2013-10-31 16:19:53,444 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:19:53,444 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:19:53,445 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5860927746139113368_1392 size 183
2013-10-31 16:19:53,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,472 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml. blk_-8691688367478710441_1393
2013-10-31 16:19:53,473 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8691688367478710441_1393 src: /127.0.0.1:36643 dest: /127.0.0.1:38271
2013-10-31 16:19:53,475 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8691688367478710441_1393 src: /127.0.0.1:56680 dest: /127.0.0.1:41648
2013-10-31 16:19:53,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8691688367478710441_1393 src: /127.0.0.1:49678 dest: /127.0.0.1:47311
2013-10-31 16:19:53,480 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49678, dest: /127.0.0.1:47311, bytes: 28750, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8691688367478710441_1393, duration: 238313
2013-10-31 16:19:53,480 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8691688367478710441_1393 terminating
2013-10-31 16:19:53,481 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56680, dest: /127.0.0.1:41648, bytes: 28750, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8691688367478710441_1393, duration: 969974
2013-10-31 16:19:53,481 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8691688367478710441_1393 terminating
2013-10-31 16:19:53,481 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8691688367478710441_1393 size 28750
2013-10-31 16:19:53,481 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36643, dest: /127.0.0.1:38271, bytes: 28750, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 1831610
2013-10-31 16:19:53,482 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8691688367478710441_1393 terminating
2013-10-31 16:19:53,482 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8691688367478710441_1393 size 28750
2013-10-31 16:19:53,484 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml from client DFSClient_1457307213
2013-10-31 16:19:53,484 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml is closed by DFSClient_1457307213
2013-10-31 16:19:53,486 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8691688367478710441_1393 size 28750
2013-10-31 16:19:53,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml dst=null perm=null
2013-10-31 16:19:53,503 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36647, bytes: 28978, op: HDFS_READ, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 387786
2013-10-31 16:19:53,522 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0034: nMaps=5 nReduces=0 max=-1
2013-10-31 16:19:53,523 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0034 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:19:53,523 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0034
2013-10-31 16:19:53,523 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0034 RESULT=SUCCESS
2013-10-31 16:19:53,523 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0034
2013-10-31 16:19:53,524 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs*rhs] submitted hadoop job: job_20131031160444934_0034
2013-10-31 16:19:53,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:53,555 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml. blk_-8704972263531238624_1395
2013-10-31 16:19:53,557 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8704972263531238624_1395 src: /127.0.0.1:56684 dest: /127.0.0.1:41648
2013-10-31 16:19:53,558 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8704972263531238624_1395 src: /127.0.0.1:49682 dest: /127.0.0.1:47311
2013-10-31 16:19:53,560 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8704972263531238624_1395 src: /127.0.0.1:36650 dest: /127.0.0.1:38271
2013-10-31 16:19:53,564 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36650, dest: /127.0.0.1:38271, bytes: 28815, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8704972263531238624_1395, duration: 621603
2013-10-31 16:19:53,564 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8704972263531238624_1395 terminating
2013-10-31 16:19:53,565 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49682, dest: /127.0.0.1:47311, bytes: 28815, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8704972263531238624_1395, duration: 1785158
2013-10-31 16:19:53,565 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8704972263531238624_1395 terminating
2013-10-31 16:19:53,565 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8704972263531238624_1395 size 28815
2013-10-31 16:19:53,565 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56684, dest: /127.0.0.1:41648, bytes: 28815, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8704972263531238624_1395, duration: 2414255
2013-10-31 16:19:53,566 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8704972263531238624_1395 terminating
2013-10-31 16:19:53,566 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8704972263531238624_1395 size 28815
2013-10-31 16:19:53,569 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml from client DFSClient_-1483996041
2013-10-31 16:19:53,570 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_conf.xml is closed by DFSClient_-1483996041
2013-10-31 16:19:53,570 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8704972263531238624_1395 size 28815
2013-10-31 16:19:54,358 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-1839156841999928741_1390 to datanode(s) 127.0.0.1:50942
2013-10-31 16:19:54,359 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_3881077061080299198_1387
2013-10-31 16:19:54,359 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_3881077061080299198_1387
2013-10-31 16:19:54,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:19:54,395 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken. blk_4679661962309866501_1396
2013-10-31 16:19:54,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679661962309866501_1396 src: /127.0.0.1:36651 dest: /127.0.0.1:38271
2013-10-31 16:19:54,398 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679661962309866501_1396 src: /127.0.0.1:49685 dest: /127.0.0.1:47311
2013-10-31 16:19:54,400 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4679661962309866501_1396 src: /127.0.0.1:36584 dest: /127.0.0.1:50942
2013-10-31 16:19:54,403 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36584, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4679661962309866501_1396, duration: 88119
2013-10-31 16:19:54,403 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4679661962309866501_1396 terminating
2013-10-31 16:19:54,404 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49685, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 1005827
2013-10-31 16:19:54,404 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4679661962309866501_1396 size 116
2013-10-31 16:19:54,404 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4679661962309866501_1396 terminating
2013-10-31 16:19:54,405 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36651, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4679661962309866501_1396, duration: 2110548
2013-10-31 16:19:54,405 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4679661962309866501_1396 size 116
2013-10-31 16:19:54,405 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4679661962309866501_1396 terminating
2013-10-31 16:19:54,408 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4679661962309866501_1396 size 116
2013-10-31 16:19:54,408 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken from client DFSClient_1457307213
2013-10-31 16:19:54,409 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken is closed by DFSClient_1457307213
2013-10-31 16:19:54,416 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken
2013-10-31 16:19:54,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.splitmetainfo dst=null perm=null
2013-10-31 16:19:54,420 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49687, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5860927746139113368_1392, duration: 271478
2013-10-31 16:19:54,421 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0034 = 19. Number of splits = 5
2013-10-31 16:19:54,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,422 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:19:54,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0034 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:19:54,426 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0034 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:19:55,032 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0034_m_000006_0' to tip task_20131031160444934_0034_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:19:55,037 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000002_0'
2013-10-31 16:19:55,037 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0033_m_000003_0'
2013-10-31 16:19:55,039 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:19:55,039 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000006_0 which needs 1 slots
2013-10-31 16:19:55,039 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000006_0 which needs 1 slots
2013-10-31 16:19:55,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken dst=null perm=null
2013-10-31 16:19:55,044 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49689, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 289454
2013-10-31 16:19:55,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml dst=null perm=null
2013-10-31 16:19:55,053 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36658, bytes: 28978, op: HDFS_READ, cliID: DFSClient_-873370843, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 391088
2013-10-31 16:19:55,080 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:19:55,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar dst=null perm=null
2013-10-31 16:19:55,113 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49692, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-873370843, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1839156841999928741_1390, duration: 1446808
2013-10-31 16:19:55,205 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0033_m_-357406308
2013-10-31 16:19:55,213 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30981 with signal TERM. Exit code 0
2013-10-31 16:19:55,213 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_408401697
2013-10-31 16:19:55,214 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_408401697 spawned.
2013-10-31 16:19:55,215 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000006_0/taskjvm.sh
2013-10-31 16:19:55,844 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:55,844 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:55,844 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:55,844 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-357406308 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:56,550 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_408401697 given task: attempt_20131031160444934_0034_m_000006_0
2013-10-31 16:19:56,927 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-1839156841999928741_1390 to 127.0.0.1:50942
2013-10-31 16:19:56,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3881077061080299198_1387 file build/test/data/dfs/data/data2/current/blk_3881077061080299198 for deletion
2013-10-31 16:19:56,928 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3881077061080299198_1387 at file build/test/data/dfs/data/data2/current/blk_3881077061080299198
2013-10-31 16:19:56,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1839156841999928741_1390 src: /127.0.0.1:36592 dest: /127.0.0.1:50942
2013-10-31 16:19:56,928 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-1839156841999928741_1390 to /127.0.0.1:50942
2013-10-31 16:19:56,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1839156841999928741_1390 src: /127.0.0.1:36592 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:19:56,930 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1839156841999928741_1390 size 238055
2013-10-31 16:19:57,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:19:57,073 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:19:57,073 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0033_m_000005_0 not found in cache
2013-10-31 16:19:57,074 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0033 for user-log deletion with retainTimeStamp:1383322797074
2013-10-31 16:19:57,085 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:19:57,086 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0033 for user-log deletion with retainTimeStamp:1383322797085
2013-10-31 16:19:57,137 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3881077061080299198_1387 file build/test/data/dfs/data/data8/current/blk_3881077061080299198 for deletion
2013-10-31 16:19:57,137 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3881077061080299198_1387 at file build/test/data/dfs/data/data8/current/blk_3881077061080299198
2013-10-31 16:19:57,360 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_3881077061080299198_1387
2013-10-31 16:19:57,628 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_824648574 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:57,639 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31024 with signal TERM. Exit code 0
2013-10-31 16:19:57,861 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:57,861 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:57,861 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:57,861 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_824648574 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:58,144 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3881077061080299198_1387 file build/test/data/dfs/data/data5/current/blk_3881077061080299198 for deletion
2013-10-31 16:19:58,144 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3881077061080299198_1387 at file build/test/data/dfs/data/data5/current/blk_3881077061080299198
2013-10-31 16:19:58,363 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_-1857432135 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:58,374 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30920 with signal TERM. Exit code 0
2013-10-31 16:19:58,404 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_-1126263002 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:58,412 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30830 with signal TERM. Exit code 0
2013-10-31 16:19:58,529 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_r_-710893147 since job job_20131031160444934_0033 is dead
2013-10-31 16:19:58,533 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31197 with signal TERM. Exit code 0
2013-10-31 16:19:58,584 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:58,584 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:58,584 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:58,584 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-1126263002 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:19:58,603 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:58,604 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:58,604 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:58,604 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-1857432135 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:58,684 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:19:58,684 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:19:58,684 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:19:58,684 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_r_-710893147 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:19:59,991 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000006_0 0.0% setup
2013-10-31 16:19:59,994 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000006_0 is done.
2013-10-31 16:19:59,995 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000006_0 was -1
2013-10-31 16:19:59,995 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:00,039 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0033
2013-10-31 16:20:00,040 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0033 for user-log deletion with retainTimeStamp:1383322800040
2013-10-31 16:20:00,631 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0033_m_-426699948 since job job_20131031160444934_0033 is dead
2013-10-31 16:20:00,641 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31023 with signal TERM. Exit code 0
2013-10-31 16:20:01,026 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:01,027 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:01,027 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:01,027 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0033_m_-426699948 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:01,044 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000006_0' has completed task_20131031160444934_0034_m_000006 successfully.
2013-10-31 16:20:01,047 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000000_0' to tip task_20131031160444934_0034_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:01,048 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000000
2013-10-31 16:20:01,049 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000001_0' to tip task_20131031160444934_0034_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:01,049 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000001
2013-10-31 16:20:01,050 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:20:01,051 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:20:01,051 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000000_0 which needs 1 slots
2013-10-31 16:20:01,051 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000000_0 which needs 1 slots
2013-10-31 16:20:01,051 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000001_0 which needs 1 slots
2013-10-31 16:20:01,051 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0034_m_000001_0 which needs 1 slots
2013-10-31 16:20:01,070 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_29013589
2013-10-31 16:20:01,071 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_29013589 spawned.
2013-10-31 16:20:01,072 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000000_0/taskjvm.sh
2013-10-31 16:20:01,082 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000002_0' to tip task_20131031160444934_0034_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:01,082 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000002
2013-10-31 16:20:01,082 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000003_0' to tip task_20131031160444934_0034_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:01,091 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0034/attempt_20131031160444934_0034_m_000001_0. Attempting to reuse: jvm_20131031160444934_0034_m_408401697
2013-10-31 16:20:01,093 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000003
2013-10-31 16:20:01,094 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0034_m_000004_0' to tip task_20131031160444934_0034_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:01,095 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0034_m_000004
2013-10-31 16:20:01,097 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:20:01,097 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:20:01,098 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:20:01,099 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000002_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000004_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000002_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000004_0 which needs 1 slots
2013-10-31 16:20:01,099 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000003_0 which needs 1 slots
2013-10-31 16:20:01,100 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0034_m_000003_0 which needs 1 slots
2013-10-31 16:20:01,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken dst=null perm=null
2013-10-31 16:20:01,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034/jobToken dst=null perm=null
2013-10-31 16:20:01,105 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49697, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 305505
2013-10-31 16:20:01,105 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49698, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4679661962309866501_1396, duration: 284010
2013-10-31 16:20:01,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml dst=null perm=null
2013-10-31 16:20:01,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.xml dst=null perm=null
2013-10-31 16:20:01,115 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36668, bytes: 28978, op: HDFS_READ, cliID: DFSClient_1881494894, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 376068
2013-10-31 16:20:01,116 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36669, bytes: 28978, op: HDFS_READ, cliID: DFSClient_2055900766, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8691688367478710441_1393, duration: 419730
2013-10-31 16:20:01,149 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:01,150 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:01,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar dst=null perm=null
2013-10-31 16:20:01,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49703, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2055900766, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1839156841999928741_1390, duration: 707705
2013-10-31 16:20:01,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.jar dst=null perm=null
2013-10-31 16:20:01,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56707, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1881494894, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1839156841999928741_1390, duration: 632935
2013-10-31 16:20:01,244 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_33509852
2013-10-31 16:20:01,245 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_33509852 spawned.
2013-10-31 16:20:01,245 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_-112746602
2013-10-31 16:20:01,245 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_-2125602537
2013-10-31 16:20:01,246 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_-112746602 spawned.
2013-10-31 16:20:01,246 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_-2125602537 spawned.
2013-10-31 16:20:01,247 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000002_0/taskjvm.sh
2013-10-31 16:20:01,248 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000003_0/taskjvm.sh
2013-10-31 16:20:01,248 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000004_0/taskjvm.sh
2013-10-31 16:20:01,552 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_408401697 given task: attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:01,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=null
2013-10-31 16:20:01,697 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36673, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2322401317774502462_1391, duration: 161362
2013-10-31 16:20:01,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:01,757 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49707, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 131231
2013-10-31 16:20:01,765 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2110 Total time for transactions(ms): 46Number of transactions batched in Syncs: 227 Number of syncs: 1512 SyncTimes(ms): 71472 15023
2013-10-31 16:20:01,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:01,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:01,999 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_29013589 given task: attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:02,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0 dst=null perm=null
2013-10-31 16:20:02,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:02,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:02,355 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36676, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6547866045732676229_1388, duration: 145370
2013-10-31 16:20:02,377 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001. blk_-381001259991911914_1397
2013-10-31 16:20:02,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-381001259991911914_1397 src: /127.0.0.1:49710 dest: /127.0.0.1:47311
2013-10-31 16:20:02,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-381001259991911914_1397 src: /127.0.0.1:36609 dest: /127.0.0.1:50942
2013-10-31 16:20:02,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-381001259991911914_1397 src: /127.0.0.1:36679 dest: /127.0.0.1:38271
2013-10-31 16:20:02,398 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36679, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-381001259991911914_1397, duration: 1294583
2013-10-31 16:20:02,399 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-381001259991911914_1397 terminating
2013-10-31 16:20:02,399 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36609, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-381001259991911914_1397, duration: 1791628
2013-10-31 16:20:02,399 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-381001259991911914_1397 terminating
2013-10-31 16:20:02,399 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-381001259991911914_1397 size 8
2013-10-31 16:20:02,399 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49710, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 2224525
2013-10-31 16:20:02,400 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-381001259991911914_1397 terminating
2013-10-31 16:20:02,401 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-381001259991911914_1397 size 8
2013-10-31 16:20:02,401 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:02,402 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:02,403 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-381001259991911914_1397 size 8
2013-10-31 16:20:02,753 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_33509852 given task: attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:02,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=null
2013-10-31 16:20:02,804 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49716, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 168009
2013-10-31 16:20:02,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:02,967 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_-2125602537 given task: attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:02,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:02,978 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_-112746602 given task: attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:02,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,004 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,005 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000001_0 0.0%
2013-10-31 16:20:03,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0 dst=null perm=null
2013-10-31 16:20:03,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36686, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6547866045732676229_1388, duration: 131151
2013-10-31 16:20:03,231 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36687, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 111261
2013-10-31 16:20:03,238 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000. blk_-1599467073490731312_1398
2013-10-31 16:20:03,261 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1599467073490731312_1398 src: /127.0.0.1:36619 dest: /127.0.0.1:50942
2013-10-31 16:20:03,262 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1599467073490731312_1398 src: /127.0.0.1:56725 dest: /127.0.0.1:41648
2013-10-31 16:20:03,263 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1599467073490731312_1398 src: /127.0.0.1:49723 dest: /127.0.0.1:47311
2013-10-31 16:20:03,265 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49723, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1599467073490731312_1398, duration: 1039951
2013-10-31 16:20:03,265 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1599467073490731312_1398 terminating
2013-10-31 16:20:03,265 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56725, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1599467073490731312_1398, duration: 1417688
2013-10-31 16:20:03,266 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1599467073490731312_1398 terminating
2013-10-31 16:20:03,266 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36619, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1599467073490731312_1398, duration: 1803669
2013-10-31 16:20:03,266 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1599467073490731312_1398 terminating
2013-10-31 16:20:03,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=null
2013-10-31 16:20:03,267 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1599467073490731312_1398 size 8
2013-10-31 16:20:03,267 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1599467073490731312_1398 size 8
2013-10-31 16:20:03,269 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1599467073490731312_1398 size 8
2013-10-31 16:20:03,273 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49724, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 150720
2013-10-31 16:20:03,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:03,315 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49725, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 260553
2013-10-31 16:20:03,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:03,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=null
2013-10-31 16:20:03,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49728, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2322401317774502462_1391, duration: 167758
2013-10-31 16:20:03,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034/job.split dst=null perm=null
2013-10-31 16:20:03,493 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36627, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2322401317774502462_1391, duration: 145752
2013-10-31 16:20:03,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:03,507 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36628, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 107805
2013-10-31 16:20:03,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:03,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:03,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49731, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 120610
2013-10-31 16:20:03,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0 dst=null perm=null
2013-10-31 16:20:03,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:03,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,559 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56735, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6547866045732676229_1388, duration: 124139
2013-10-31 16:20:03,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:03,583 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002. blk_5383765050450234615_1401
2013-10-31 16:20:03,606 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5383765050450234615_1401 src: /127.0.0.1:36631 dest: /127.0.0.1:50942
2013-10-31 16:20:03,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5383765050450234615_1401 src: /127.0.0.1:56737 dest: /127.0.0.1:41648
2013-10-31 16:20:03,608 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5383765050450234615_1401 src: /127.0.0.1:49735 dest: /127.0.0.1:47311
2013-10-31 16:20:03,610 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49735, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5383765050450234615_1401, duration: 1238241
2013-10-31 16:20:03,610 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5383765050450234615_1401 terminating
2013-10-31 16:20:03,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56737, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5383765050450234615_1401, duration: 1498192
2013-10-31 16:20:03,611 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5383765050450234615_1401 terminating
2013-10-31 16:20:03,611 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36631, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5383765050450234615_1401, duration: 1870458
2013-10-31 16:20:03,611 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5383765050450234615_1401 terminating
2013-10-31 16:20:03,611 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5383765050450234615_1401 size 8
2013-10-31 16:20:03,612 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:03,612 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:03,613 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5383765050450234615_1401 size 8
2013-10-31 16:20:03,613 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5383765050450234615_1401 size 8
2013-10-31 16:20:03,660 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,660 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000002_0 0.0%
2013-10-31 16:20:03,668 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:03,668 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:03,720 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,720 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000000_0 0.0%
2013-10-31 16:20:03,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0 dst=null perm=null
2013-10-31 16:20:03,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0 dst=null perm=null
2013-10-31 16:20:03,769 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36634, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6547866045732676229_1388, duration: 139496
2013-10-31 16:20:03,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0/part-00000 dst=null perm=null
2013-10-31 16:20:03,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56740, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6547866045732676229_1388, duration: 122542
2013-10-31 16:20:03,796 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004. blk_2111446225669027015_1401
2013-10-31 16:20:03,805 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003. blk_-6688585979939867207_1401
2013-10-31 16:20:03,822 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2111446225669027015_1401 src: /127.0.0.1:56741 dest: /127.0.0.1:41648
2013-10-31 16:20:03,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2111446225669027015_1401 src: /127.0.0.1:36707 dest: /127.0.0.1:38271
2013-10-31 16:20:03,824 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2111446225669027015_1401 src: /127.0.0.1:49741 dest: /127.0.0.1:47311
2013-10-31 16:20:03,826 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49741, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2111446225669027015_1401, duration: 992023
2013-10-31 16:20:03,826 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2111446225669027015_1401 terminating
2013-10-31 16:20:03,826 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36707, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2111446225669027015_1401, duration: 1413657
2013-10-31 16:20:03,827 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2111446225669027015_1401 terminating
2013-10-31 16:20:03,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6688585979939867207_1401 src: /127.0.0.1:56742 dest: /127.0.0.1:41648
2013-10-31 16:20:03,827 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56741, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2111446225669027015_1401, duration: 1844375
2013-10-31 16:20:03,827 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2111446225669027015_1401 terminating
2013-10-31 16:20:03,828 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6688585979939867207_1401 src: /127.0.0.1:36709 dest: /127.0.0.1:38271
2013-10-31 16:20:03,828 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6688585979939867207_1401 src: /127.0.0.1:49743 dest: /127.0.0.1:47311
2013-10-31 16:20:03,829 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2111446225669027015_1401 size 8
2013-10-31 16:20:03,830 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2111446225669027015_1401 size 8
2013-10-31 16:20:03,830 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2111446225669027015_1401 size 8
2013-10-31 16:20:03,830 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49743, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6688585979939867207_1401, duration: 1030446
2013-10-31 16:20:03,830 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6688585979939867207_1401 terminating
2013-10-31 16:20:03,831 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36709, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6688585979939867207_1401, duration: 1389338
2013-10-31 16:20:03,831 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6688585979939867207_1401 terminating
2013-10-31 16:20:03,831 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56742, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0034_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6688585979939867207_1401, duration: 1786294
2013-10-31 16:20:03,831 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6688585979939867207_1401 terminating
2013-10-31 16:20:03,832 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6688585979939867207_1401 size 8
2013-10-31 16:20:03,832 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:03,832 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:03,834 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6688585979939867207_1401 size 8
2013-10-31 16:20:03,835 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6688585979939867207_1401 size 8
2013-10-31 16:20:03,884 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:03,885 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000003_0 0.0%
2013-10-31 16:20:04,056 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000000_0
2013-10-31 16:20:04,056 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000001_0
2013-10-31 16:20:04,100 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000002_0
2013-10-31 16:20:04,100 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000003_0
2013-10-31 16:20:04,229 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:04,230 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:04,301 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0034_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:04,301 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000004_0 0.0%
2013-10-31 16:20:04,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0 dst=null perm=null
2013-10-31 16:20:04,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:04,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:04,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000002_0 dst=null perm=null
2013-10-31 16:20:04,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0 dst=null perm=null
2013-10-31 16:20:04,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:05,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0 dst=null perm=null
2013-10-31 16:20:05,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0 dst=null perm=null
2013-10-31 16:20:05,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:05,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:05,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:05,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:05,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:05,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000000_0 dst=null perm=null
2013-10-31 16:20:05,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000001_0 dst=null perm=null
2013-10-31 16:20:05,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000003_0 dst=null perm=null
2013-10-31 16:20:05,728 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:05,729 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000000_0 is done.
2013-10-31 16:20:05,729 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000000_0 was -1
2013-10-31 16:20:05,730 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:06,051 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0034_m_000006_0
2013-10-31 16:20:06,051 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0034_m_000006_0
2013-10-31 16:20:06,052 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000006_0 not found in cache
2013-10-31 16:20:06,199 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:20:06,201 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000002_0 is done.
2013-10-31 16:20:06,201 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000002_0 was -1
2013-10-31 16:20:06,202 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:06,420 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:06,421 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000003_0 is done.
2013-10-31 16:20:06,421 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000003_0 was -1
2013-10-31 16:20:06,421 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:07,059 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000000_0' has completed task_20131031160444934_0034_m_000000 successfully.
2013-10-31 16:20:07,104 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000002_0' has completed task_20131031160444934_0034_m_000002 successfully.
2013-10-31 16:20:07,106 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000003_0' has completed task_20131031160444934_0034_m_000003 successfully.
2013-10-31 16:20:07,108 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0034_m_000004_0
2013-10-31 16:20:07,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0 dst=null perm=null
2013-10-31 16:20:07,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:07,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:07,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/_attempt_20131031160444934_0034_m_000004_0 dst=null perm=null
2013-10-31 16:20:07,689 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:07,693 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:07,694 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000001_0 is done.
2013-10-31 16:20:07,694 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000001_0 was -1
2013-10-31 16:20:07,695 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:09,461 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:09,464 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:09,467 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000004_0 is done.
2013-10-31 16:20:09,468 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000004_0 was -1
2013-10-31 16:20:09,468 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:10,064 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000001_0' has completed task_20131031160444934_0034_m_000001 successfully.
2013-10-31 16:20:10,112 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000004_0' has completed task_20131031160444934_0034_m_000004 successfully.
2013-10-31 16:20:10,114 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0034_m_000005_0' to tip task_20131031160444934_0034_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:10,116 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0034_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:20:10,117 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0034_m_000005_0 which needs 1 slots
2013-10-31 16:20:10,117 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0034_m_000005_0 which needs 1 slots
2013-10-31 16:20:10,150 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0034_m_-478655554
2013-10-31 16:20:10,151 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0034_m_-478655554 spawned.
2013-10-31 16:20:10,152 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0034/attempt_20131031160444934_0034_m_000005_0/taskjvm.sh
2013-10-31 16:20:11,082 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0034_m_-478655554 given task: attempt_20131031160444934_0034_m_000005_0
2013-10-31 16:20:11,588 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000005_0 0.0%
2013-10-31 16:20:11,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary dst=null perm=null
2013-10-31 16:20:11,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:11,617 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS from client DFSClient_attempt_20131031160444934_0034_m_000005_0
2013-10-31 16:20:11,617 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0034_m_000005_0
2013-10-31 16:20:11,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:11,624 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1839156841999928741 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:11,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:11,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2322401317774502462 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:11,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5860927746139113368 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5860927746139113368 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:11,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5860927746139113368 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8691688367478710441 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:11,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8691688367478710441 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:11,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8691688367478710441 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:11,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0034 dst=null perm=null
2013-10-31 16:20:12,362 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8691688367478710441_1393 blk_-2322401317774502462_1391 blk_-1839156841999928741_1390
2013-10-31 16:20:12,363 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-8691688367478710441_1393 blk_-2322401317774502462_1391 blk_-5860927746139113368_1392 blk_-1839156841999928741_1390
2013-10-31 16:20:12,532 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8691688367478710441_1393 file build/test/data/dfs/data/data3/current/blk_-8691688367478710441 for deletion
2013-10-31 16:20:12,532 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5860927746139113368_1392 file build/test/data/dfs/data/data4/current/blk_-5860927746139113368 for deletion
2013-10-31 16:20:12,532 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8691688367478710441_1393 at file build/test/data/dfs/data/data3/current/blk_-8691688367478710441
2013-10-31 16:20:12,533 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5860927746139113368_1392 at file build/test/data/dfs/data/data4/current/blk_-5860927746139113368
2013-10-31 16:20:12,532 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data3/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:12,533 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data4/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:12,534 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data3/current/blk_-2322401317774502462
2013-10-31 16:20:12,534 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data4/current/blk_-1839156841999928741
2013-10-31 16:20:13,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8691688367478710441_1393 file build/test/data/dfs/data/data6/current/blk_-8691688367478710441 for deletion
2013-10-31 16:20:13,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data5/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:13,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8691688367478710441_1393 at file build/test/data/dfs/data/data6/current/blk_-8691688367478710441
2013-10-31 16:20:13,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data6/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:13,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data5/current/blk_-2322401317774502462
2013-10-31 16:20:13,150 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data6/current/blk_-1839156841999928741
2013-10-31 16:20:14,523 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0034_m_000005_0 0.0% cleanup
2013-10-31 16:20:14,525 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0034_m_000005_0 is done.
2013-10-31 16:20:14,525 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0034_m_000005_0 was -1
2013-10-31 16:20:14,526 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:15,363 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-2322401317774502462_1391 blk_-5860927746139113368_1392 blk_-1839156841999928741_1390
2013-10-31 16:20:15,363 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-8691688367478710441_1393 blk_-2322401317774502462_1391 blk_-5860927746139113368_1392 blk_-1839156841999928741_1390
2013-10-31 16:20:16,123 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0034_m_000005_0' has completed task_20131031160444934_0034_m_000005 successfully.
2013-10-31 16:20:16,124 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0034 has completed successfully.
2013-10-31 16:20:16,125 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0034,submitTime=1383236393494,launchTime=1383236394425,firstMapTaskLaunchTime=1383236401047,firstJobSetupTaskLaunchTime=1383236395032,firstJobCleanupTaskLaunchTime=1383236410114,finishTime=1383236416124,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1686E7C7AC8C482C92D85BC9B258DF0C/B43CBD7F38E24877AF2CE749872D44CC] lhs*rhs/(1/2) ...orm/samepipearoundgroupby
2013-10-31 16:20:16,130 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877. blk_7392982790106358873_1402
2013-10-31 16:20:16,132 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7392982790106358873_1402 src: /127.0.0.1:36645 dest: /127.0.0.1:50942
2013-10-31 16:20:16,134 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7392982790106358873_1402 src: /127.0.0.1:36715 dest: /127.0.0.1:38271
2013-10-31 16:20:16,136 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7392982790106358873_1402 src: /127.0.0.1:49749 dest: /127.0.0.1:47311
2013-10-31 16:20:16,146 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49749, dest: /127.0.0.1:47311, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7392982790106358873_1402, duration: 5842388
2013-10-31 16:20:16,146 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7392982790106358873_1402 terminating
2013-10-31 16:20:16,147 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36715, dest: /127.0.0.1:38271, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7392982790106358873_1402, duration: 4174235
2013-10-31 16:20:16,147 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7392982790106358873_1402 terminating
2013-10-31 16:20:16,148 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36645, dest: /127.0.0.1:50942, bytes: 26337, op: HDFS_WRITE, cliID: DFSClient_-1483996041, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7392982790106358873_1402, duration: 6921536
2013-10-31 16:20:16,148 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7392982790106358873_1402 terminating
2013-10-31 16:20:16,154 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7392982790106358873_1402 size 26337
2013-10-31 16:20:16,154 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877 from client DFSClient_-1483996041
2013-10-31 16:20:16,155 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_logs/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877 is closed by DFSClient_-1483996041
2013-10-31 16:20:16,155 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7392982790106358873_1402 size 26337
2013-10-31 16:20:16,156 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7392982790106358873_1402 size 26337
2013-10-31 16:20:16,163 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0034_1383236393494_hadoop_%5B1686E7C7AC8C482C92D85BC9B258DF0C%2FB43CBD7F38E24877 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:16,164 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000004_0'
2013-10-31 16:20:16,164 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000005_0'
2013-10-31 16:20:16,166 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679661962309866501 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:16,171 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679661962309866501 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:16,171 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4679661962309866501 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:16,173 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0034_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:16,176 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4238039309339233228 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:16,176 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4238039309339233228 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:16,177 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4238039309339233228 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:16,177 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-499582711603059738 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:16,177 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-499582711603059738 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:16,177 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-499582711603059738 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:16,177 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6547866045732676229 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:16,178 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6547866045732676229 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:16,178 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6547866045732676229 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:16,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0034 dst=null perm=null
2013-10-31 16:20:16,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/8248731207_rhs_02B03C33116E4645B74919D0799D60B0 dst=null perm=null
2013-10-31 16:20:16,186 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/_temporary
2013-10-31 16:20:16,203 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:16,203 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0034 being deleted.
2013-10-31 16:20:16,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=null
2013-10-31 16:20:16,206 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:16,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000 dst=null perm=null
2013-10-31 16:20:16,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001 dst=null perm=null
2013-10-31 16:20:16,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002 dst=null perm=null
2013-10-31 16:20:16,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003 dst=null perm=null
2013-10-31 16:20:16,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004 dst=null perm=null
2013-10-31 16:20:16,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000 dst=null perm=null
2013-10-31 16:20:16,214 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56754, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1599467073490731312_1398, duration: 277147
2013-10-31 16:20:16,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001 dst=null perm=null
2013-10-31 16:20:16,217 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49752, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 261816
2013-10-31 16:20:16,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002 dst=null perm=null
2013-10-31 16:20:16,219 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56756, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5383765050450234615_1401, duration: 268423
2013-10-31 16:20:16,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003 dst=null perm=null
2013-10-31 16:20:16,221 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36721, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6688585979939867207_1401, duration: 264868
2013-10-31 16:20:16,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004 dst=null perm=null
2013-10-31 16:20:16,223 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56758, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2111446225669027015_1401, duration: 265389
2013-10-31 16:20:16,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=null
2013-10-31 16:20:16,234 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:16,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000 dst=null perm=null
2013-10-31 16:20:16,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001 dst=null perm=null
2013-10-31 16:20:16,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002 dst=null perm=null
2013-10-31 16:20:16,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003 dst=null perm=null
2013-10-31 16:20:16,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004 dst=null perm=null
2013-10-31 16:20:16,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000 dst=null perm=null
2013-10-31 16:20:16,243 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36654, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1599467073490731312_1398, duration: 268884
2013-10-31 16:20:16,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001 dst=null perm=null
2013-10-31 16:20:16,246 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49757, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 255385
2013-10-31 16:20:16,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002 dst=null perm=null
2013-10-31 16:20:16,248 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49758, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5383765050450234615_1401, duration: 258235
2013-10-31 16:20:16,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003 dst=null perm=null
2013-10-31 16:20:16,252 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56762, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6688585979939867207_1401, duration: 258134
2013-10-31 16:20:16,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004 dst=null perm=null
2013-10-31 16:20:16,255 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36727, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2111446225669027015_1401, duration: 260667
2013-10-31 16:20:16,255 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipearoundgroupby
2013-10-31 16:20:16,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=null
2013-10-31 16:20:16,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00000 dst=null perm=null
2013-10-31 16:20:16,264 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56764, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1599467073490731312_1398, duration: 249066
2013-10-31 16:20:16,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00001 dst=null perm=null
2013-10-31 16:20:16,268 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49762, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-381001259991911914_1397, duration: 250269
2013-10-31 16:20:16,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00002 dst=null perm=null
2013-10-31 16:20:16,272 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49763, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5383765050450234615_1401, duration: 249560
2013-10-31 16:20:16,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00003 dst=null perm=null
2013-10-31 16:20:16,276 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56767, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6688585979939867207_1401, duration: 249697
2013-10-31 16:20:16,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipearoundgroupby/part-00004 dst=null perm=null
2013-10-31 16:20:16,281 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49765, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2111446225669027015_1401, duration: 254135
2013-10-31 16:20:16,299 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:20:16,300 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:20:16,312 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] starting
2013-10-31 16:20:16,312 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:20:16,313 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2"]
2013-10-31 16:20:16,313 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] parallel execution is enabled: true
2013-10-31 16:20:16,313 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] starting jobs: 1
2013-10-31 16:20:16,313 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] allocating threads: 1
2013-10-31 16:20:16,314 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] starting step: (1/1) ...edpipesplatform/samepipe2
2013-10-31 16:20:16,317 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:20:16,317 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:20:16,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:16,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:20:16,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,341 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar. blk_-829965190113103341_1403
2013-10-31 16:20:16,342 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:49766 dest: /127.0.0.1:47311
2013-10-31 16:20:16,344 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:56770 dest: /127.0.0.1:41648
2013-10-31 16:20:16,346 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:36666 dest: /127.0.0.1:50942
2013-10-31 16:20:16,354 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36666, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-829965190113103341_1403, duration: 3806102
2013-10-31 16:20:16,354 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-829965190113103341_1403 terminating
2013-10-31 16:20:16,354 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:16,355 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56770, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-829965190113103341_1403, duration: 4631186
2013-10-31 16:20:16,355 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-829965190113103341_1403 terminating
2013-10-31 16:20:16,356 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49766, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-829965190113103341_1403, duration: 5736724
2013-10-31 16:20:16,356 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-829965190113103341_1403 terminating
2013-10-31 16:20:16,356 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:16,358 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar from client DFSClient_1457307213
2013-10-31 16:20:16,358 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar is closed by DFSClient_1457307213
2013-10-31 16:20:16,360 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:16,878 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar. New replication is 10
2013-10-31 16:20:16,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar dst=null perm=null
2013-10-31 16:20:16,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,894 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:20:16,898 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:20:16,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:16,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,917 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split. New replication is 10
2013-10-31 16:20:16,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=null
2013-10-31 16:20:16,926 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split. blk_4490428191685297632_1404
2013-10-31 16:20:16,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:49769 dest: /127.0.0.1:47311
2013-10-31 16:20:16,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:36737 dest: /127.0.0.1:38271
2013-10-31 16:20:16,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:36669 dest: /127.0.0.1:50942
2013-10-31 16:20:16,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4490428191685297632_1404 src: /127.0.0.1:56775 dest: /127.0.0.1:41648
2013-10-31 16:20:16,936 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56775, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4490428191685297632_1404, duration: 88019
2013-10-31 16:20:16,937 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,937 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36669, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4490428191685297632_1404, duration: 913965
2013-10-31 16:20:16,937 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,938 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,938 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36737, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4490428191685297632_1404, duration: 1867714
2013-10-31 16:20:16,939 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,939 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,939 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49769, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4490428191685297632_1404, duration: 2959404
2013-10-31 16:20:16,939 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,940 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4490428191685297632_1404 terminating
2013-10-31 16:20:16,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4490428191685297632_1404 size 1732
2013-10-31 16:20:16,942 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split from client DFSClient_1457307213
2013-10-31 16:20:16,942 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split is closed by DFSClient_1457307213
2013-10-31 16:20:16,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,963 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo. blk_4927569461534459951_1405
2013-10-31 16:20:16,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4927569461534459951_1405 src: /127.0.0.1:36671 dest: /127.0.0.1:50942
2013-10-31 16:20:16,967 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4927569461534459951_1405 src: /127.0.0.1:56777 dest: /127.0.0.1:41648
2013-10-31 16:20:16,968 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4927569461534459951_1405 src: /127.0.0.1:36742 dest: /127.0.0.1:38271
2013-10-31 16:20:16,971 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36742, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4927569461534459951_1405, duration: 64327
2013-10-31 16:20:16,972 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4927569461534459951_1405 terminating
2013-10-31 16:20:16,972 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56777, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4927569461534459951_1405, duration: 852277
2013-10-31 16:20:16,973 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4927569461534459951_1405 terminating
2013-10-31 16:20:16,973 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36671, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4927569461534459951_1405, duration: 1694186
2013-10-31 16:20:16,974 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4927569461534459951_1405 terminating
2013-10-31 16:20:16,977 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4927569461534459951_1405 size 183
2013-10-31 16:20:16,977 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:20:16,978 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:20:16,978 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4927569461534459951_1405 size 183
2013-10-31 16:20:16,979 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4927569461534459951_1405 size 183
2013-10-31 16:20:16,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:16,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,004 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml. blk_6784548083507528066_1406
2013-10-31 16:20:17,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6784548083507528066_1406 src: /127.0.0.1:49776 dest: /127.0.0.1:47311
2013-10-31 16:20:17,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6784548083507528066_1406 src: /127.0.0.1:36675 dest: /127.0.0.1:50942
2013-10-31 16:20:17,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6784548083507528066_1406 src: /127.0.0.1:36745 dest: /127.0.0.1:38271
2013-10-31 16:20:17,012 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36745, dest: /127.0.0.1:38271, bytes: 27611, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6784548083507528066_1406, duration: 870554
2013-10-31 16:20:17,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6784548083507528066_1406 terminating
2013-10-31 16:20:17,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36675, dest: /127.0.0.1:50942, bytes: 27611, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6784548083507528066_1406, duration: 1704705
2013-10-31 16:20:17,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6784548083507528066_1406 terminating
2013-10-31 16:20:17,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49776, dest: /127.0.0.1:47311, bytes: 27611, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6784548083507528066_1406, duration: 2603806
2013-10-31 16:20:17,015 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6784548083507528066_1406 terminating
2013-10-31 16:20:17,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6784548083507528066_1406 size 27611
2013-10-31 16:20:17,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6784548083507528066_1406 size 27611
2013-10-31 16:20:17,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6784548083507528066_1406 size 27611
2013-10-31 16:20:17,018 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml from client DFSClient_1457307213
2013-10-31 16:20:17,018 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml is closed by DFSClient_1457307213
2013-10-31 16:20:17,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml dst=null perm=null
2013-10-31 16:20:17,031 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49780, bytes: 27827, op: HDFS_READ, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6784548083507528066_1406, duration: 451771
2013-10-31 16:20:17,038 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0035: nMaps=5 nReduces=0 max=-1
2013-10-31 16:20:17,039 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0035 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:20:17,039 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0035 RESULT=SUCCESS
2013-10-31 16:20:17,039 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0035
2013-10-31 16:20:17,039 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0035
2013-10-31 16:20:17,039 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] submitted hadoop job: job_20131031160444934_0035
2013-10-31 16:20:17,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,072 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml. blk_-8782215469058667875_1408
2013-10-31 16:20:17,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8782215469058667875_1408 src: /127.0.0.1:36748 dest: /127.0.0.1:38271
2013-10-31 16:20:17,075 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8782215469058667875_1408 src: /127.0.0.1:36680 dest: /127.0.0.1:50942
2013-10-31 16:20:17,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8782215469058667875_1408 src: /127.0.0.1:56786 dest: /127.0.0.1:41648
2013-10-31 16:20:17,081 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56786, dest: /127.0.0.1:41648, bytes: 27676, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8782215469058667875_1408, duration: 697233
2013-10-31 16:20:17,082 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8782215469058667875_1408 terminating
2013-10-31 16:20:17,082 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36680, dest: /127.0.0.1:50942, bytes: 27676, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8782215469058667875_1408, duration: 1516586
2013-10-31 16:20:17,083 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8782215469058667875_1408 terminating
2013-10-31 16:20:17,083 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36748, dest: /127.0.0.1:38271, bytes: 27676, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8782215469058667875_1408, duration: 2576509
2013-10-31 16:20:17,083 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8782215469058667875_1408 terminating
2013-10-31 16:20:17,085 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8782215469058667875_1408 size 27676
2013-10-31 16:20:17,086 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml from client DFSClient_-604205094
2013-10-31 16:20:17,087 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_conf.xml is closed by DFSClient_-604205094
2013-10-31 16:20:17,087 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8782215469058667875_1408 size 27676
2013-10-31 16:20:17,087 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8782215469058667875_1408 size 27676
2013-10-31 16:20:17,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:17,580 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken. blk_-8369650424871952839_1409
2013-10-31 16:20:17,581 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8369650424871952839_1409 src: /127.0.0.1:36751 dest: /127.0.0.1:38271
2013-10-31 16:20:17,583 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8369650424871952839_1409 src: /127.0.0.1:36683 dest: /127.0.0.1:50942
2013-10-31 16:20:17,585 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8369650424871952839_1409 src: /127.0.0.1:56789 dest: /127.0.0.1:41648
2013-10-31 16:20:17,588 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56789, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8369650424871952839_1409, duration: 371945
2013-10-31 16:20:17,588 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8369650424871952839_1409 terminating
2013-10-31 16:20:17,589 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8369650424871952839_1409 size 116
2013-10-31 16:20:17,589 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36683, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8369650424871952839_1409, duration: 1134880
2013-10-31 16:20:17,589 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8369650424871952839_1409 terminating
2013-10-31 16:20:17,590 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36751, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8369650424871952839_1409, duration: 2059812
2013-10-31 16:20:17,591 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8369650424871952839_1409 terminating
2013-10-31 16:20:17,592 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8369650424871952839_1409 size 116
2013-10-31 16:20:17,593 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken from client DFSClient_1457307213
2013-10-31 16:20:17,593 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken is closed by DFSClient_1457307213
2013-10-31 16:20:17,594 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8369650424871952839_1409 size 116
2013-10-31 16:20:17,603 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken
2013-10-31 16:20:17,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.splitmetainfo dst=null perm=null
2013-10-31 16:20:17,607 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36754, bytes: 187, op: HDFS_READ, cliID: DFSClient_-604205094, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4927569461534459951_1405, duration: 270443
2013-10-31 16:20:17,609 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0035 = 19. Number of splits = 5
2013-10-31 16:20:17,609 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,609 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,610 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,611 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,612 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:17,613 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0035 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:20:17,613 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0035 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:20:17,934 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8691688367478710441_1393 file build/test/data/dfs/data/data1/current/blk_-8691688367478710441 for deletion
2013-10-31 16:20:17,934 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5860927746139113368_1392 file build/test/data/dfs/data/data2/current/blk_-5860927746139113368 for deletion
2013-10-31 16:20:17,934 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8691688367478710441_1393 at file build/test/data/dfs/data/data1/current/blk_-8691688367478710441
2013-10-31 16:20:17,934 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data1/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:17,934 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5860927746139113368_1392 at file build/test/data/dfs/data/data2/current/blk_-5860927746139113368
2013-10-31 16:20:17,935 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data1/current/blk_-2322401317774502462
2013-10-31 16:20:17,935 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data2/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:17,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data2/current/blk_-1839156841999928741
2013-10-31 16:20:18,144 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5860927746139113368_1392 file build/test/data/dfs/data/data7/current/blk_-5860927746139113368 for deletion
2013-10-31 16:20:18,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2322401317774502462_1391 file build/test/data/dfs/data/data8/current/blk_-2322401317774502462 for deletion
2013-10-31 16:20:18,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5860927746139113368_1392 at file build/test/data/dfs/data/data7/current/blk_-5860927746139113368
2013-10-31 16:20:18,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1839156841999928741_1390 file build/test/data/dfs/data/data7/current/blk_-1839156841999928741 for deletion
2013-10-31 16:20:18,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2322401317774502462_1391 at file build/test/data/dfs/data/data8/current/blk_-2322401317774502462
2013-10-31 16:20:18,146 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1839156841999928741_1390 at file build/test/data/dfs/data/data7/current/blk_-1839156841999928741
2013-10-31 16:20:18,364 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:50942 to replicate blk_-829965190113103341_1403 to datanode(s) 127.0.0.1:38271
2013-10-31 16:20:18,365 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-499582711603059738_1386 blk_6547866045732676229_1388 blk_4679661962309866501_1396
2013-10-31 16:20:18,365 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-499582711603059738_1386 blk_-4238039309339233228_1389 blk_4679661962309866501_1396
2013-10-31 16:20:18,534 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4238039309339233228_1389 file build/test/data/dfs/data/data3/current/blk_-4238039309339233228 for deletion
2013-10-31 16:20:18,534 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-499582711603059738_1386 file build/test/data/dfs/data/data4/current/blk_-499582711603059738 for deletion
2013-10-31 16:20:18,534 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4238039309339233228_1389 at file build/test/data/dfs/data/data3/current/blk_-4238039309339233228
2013-10-31 16:20:18,534 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679661962309866501_1396 file build/test/data/dfs/data/data3/current/blk_4679661962309866501 for deletion
2013-10-31 16:20:18,535 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-499582711603059738_1386 at file build/test/data/dfs/data/data4/current/blk_-499582711603059738
2013-10-31 16:20:18,535 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679661962309866501_1396 at file build/test/data/dfs/data/data3/current/blk_4679661962309866501
2013-10-31 16:20:19,078 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0035_m_000006_0' to tip task_20131031160444934_0035_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:19,082 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000000_0'
2013-10-31 16:20:19,082 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000001_0'
2013-10-31 16:20:19,083 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000006_0'
2013-10-31 16:20:19,084 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated InterTrackerProtocol.heartbeat 52 raw values into 15 aggregated values, total 15
2013-10-31 16:20:19,085 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:20:19,085 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000006_0 which needs 1 slots
2013-10-31 16:20:19,085 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000006_0 which needs 1 slots
2013-10-31 16:20:19,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken dst=null perm=null
2013-10-31 16:20:19,094 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36686, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8369650424871952839_1409, duration: 288981
2013-10-31 16:20:19,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml dst=null perm=null
2013-10-31 16:20:19,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36688, bytes: 27827, op: HDFS_READ, cliID: DFSClient_-2143966140, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6784548083507528066_1406, duration: 386777
2013-10-31 16:20:19,121 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000002_0'
2013-10-31 16:20:19,122 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0034_m_000003_0'
2013-10-31 16:20:19,135 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:19,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar dst=null perm=null
2013-10-31 16:20:19,161 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56794, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2143966140, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-829965190113103341_1403, duration: 1244371
2013-10-31 16:20:19,255 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0034_m_29013589
2013-10-31 16:20:19,261 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31559 with signal TERM. Exit code 0
2013-10-31 16:20:19,262 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-234810922
2013-10-31 16:20:19,262 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-234810922 spawned.
2013-10-31 16:20:19,263 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000006_0/taskjvm.sh
2013-10-31 16:20:19,363 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:19,363 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:19,363 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:19,364 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_29013589 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:20,543 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-234810922 given task: attempt_20131031160444934_0035_m_000006_0
2013-10-31 16:20:21,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:21,144 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535) Starting thread to transfer block blk_-829965190113103341_1403 to 127.0.0.1:38271
2013-10-31 16:20:21,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-499582711603059738_1386 file build/test/data/dfs/data/data7/current/blk_-499582711603059738 for deletion
2013-10-31 16:20:21,146 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679661962309866501_1396 file build/test/data/dfs/data/data8/current/blk_4679661962309866501 for deletion
2013-10-31 16:20:21,146 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-499582711603059738_1386 at file build/test/data/dfs/data/data7/current/blk_-499582711603059738
2013-10-31 16:20:21,146 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6547866045732676229_1388 file build/test/data/dfs/data/data7/current/blk_6547866045732676229 for deletion
2013-10-31 16:20:21,146 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:50942, storageID=DS-1876337673-10.5.128.102-50942-1383235484753, infoPort=32926, ipcPort=49535):Transmitted block blk_-829965190113103341_1403 to /127.0.0.1:38271
2013-10-31 16:20:21,146 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-829965190113103341_1403 src: /127.0.0.1:36761 dest: /127.0.0.1:38271
2013-10-31 16:20:21,146 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6547866045732676229_1388 at file build/test/data/dfs/data/data7/current/blk_6547866045732676229
2013-10-31 16:20:21,146 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679661962309866501_1396 at file build/test/data/dfs/data/data8/current/blk_4679661962309866501
2013-10-31 16:20:21,150 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-829965190113103341_1403 src: /127.0.0.1:36761 dest: /127.0.0.1:38271 of size 238055
2013-10-31 16:20:21,153 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-829965190113103341_1403 size 238055
2013-10-31 16:20:21,165 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:21,166 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000005_0 not found in cache
2013-10-31 16:20:21,166 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000004_0 not found in cache
2013-10-31 16:20:21,167 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0034 for user-log deletion with retainTimeStamp:1383322821166
2013-10-31 16:20:21,366 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-499582711603059738_1386 blk_-4238039309339233228_1389 blk_6547866045732676229_1388
2013-10-31 16:20:21,366 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-4238039309339233228_1389 blk_6547866045732676229_1388 blk_4679661962309866501_1396
2013-10-31 16:20:22,010 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_-2125602537 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:22,021 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31675 with signal TERM. Exit code 0
2013-10-31 16:20:22,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4238039309339233228_1389 file build/test/data/dfs/data/data5/current/blk_-4238039309339233228 for deletion
2013-10-31 16:20:22,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-499582711603059738_1386 file build/test/data/dfs/data/data6/current/blk_-499582711603059738 for deletion
2013-10-31 16:20:22,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4238039309339233228_1389 at file build/test/data/dfs/data/data5/current/blk_-4238039309339233228
2013-10-31 16:20:22,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-499582711603059738_1386 at file build/test/data/dfs/data/data6/current/blk_-499582711603059738
2013-10-31 16:20:22,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6547866045732676229_1388 file build/test/data/dfs/data/data6/current/blk_6547866045732676229 for deletion
2013-10-31 16:20:22,153 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6547866045732676229_1388 at file build/test/data/dfs/data/data6/current/blk_6547866045732676229
2013-10-31 16:20:22,188 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:22,188 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:22,188 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:22,188 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_-2125602537 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:22,590 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_-478655554 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:22,600 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31894 with signal TERM. Exit code 0
2013-10-31 16:20:22,765 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:22,765 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:22,765 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:22,765 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_-478655554 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:23,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4238039309339233228_1389 file build/test/data/dfs/data/data1/current/blk_-4238039309339233228 for deletion
2013-10-31 16:20:23,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4679661962309866501_1396 file build/test/data/dfs/data/data1/current/blk_4679661962309866501 for deletion
2013-10-31 16:20:23,936 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4238039309339233228_1389 at file build/test/data/dfs/data/data1/current/blk_-4238039309339233228
2013-10-31 16:20:23,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6547866045732676229_1388 file build/test/data/dfs/data/data2/current/blk_6547866045732676229 for deletion
2013-10-31 16:20:23,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4679661962309866501_1396 at file build/test/data/dfs/data/data1/current/blk_4679661962309866501
2013-10-31 16:20:23,937 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6547866045732676229_1388 at file build/test/data/dfs/data/data2/current/blk_6547866045732676229
2013-10-31 16:20:24,005 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000006_0 0.0% setup
2013-10-31 16:20:24,007 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000006_0 is done.
2013-10-31 16:20:24,008 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000006_0 was -1
2013-10-31 16:20:24,008 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:24,085 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:24,086 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000000_0 not found in cache
2013-10-31 16:20:24,086 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000001_0 not found in cache
2013-10-31 16:20:24,087 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0034 for user-log deletion with retainTimeStamp:1383322824087
2013-10-31 16:20:24,122 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0034
2013-10-31 16:20:24,123 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000002_0 not found in cache
2013-10-31 16:20:24,123 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0034_m_000003_0 not found in cache
2013-10-31 16:20:24,124 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0034 for user-log deletion with retainTimeStamp:1383322824123
2013-10-31 16:20:24,736 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_408401697 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:24,746 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31401 with signal TERM. Exit code 0
2013-10-31 16:20:24,794 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_33509852 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:24,801 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31633 with signal TERM. Exit code 0
2013-10-31 16:20:24,924 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:24,924 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:24,924 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:24,924 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_408401697 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:20:24,979 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:24,979 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:24,979 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:24,980 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_33509852 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:24,996 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0034_m_-112746602 since job job_20131031160444934_0034 is dead
2013-10-31 16:20:25,006 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31674 with signal TERM. Exit code 0
2013-10-31 16:20:25,091 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000006_0' has completed task_20131031160444934_0035_m_000006 successfully.
2013-10-31 16:20:25,094 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000000_0' to tip task_20131031160444934_0035_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:25,095 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000000
2013-10-31 16:20:25,096 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000001_0' to tip task_20131031160444934_0035_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:25,096 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000001
2013-10-31 16:20:25,098 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:20:25,100 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:20:25,100 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000000_0 which needs 1 slots
2013-10-31 16:20:25,100 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000000_0 which needs 1 slots
2013-10-31 16:20:25,101 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000001_0 which needs 1 slots
2013-10-31 16:20:25,101 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0035_m_000001_0 which needs 1 slots
2013-10-31 16:20:25,129 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000002_0' to tip task_20131031160444934_0035_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:25,130 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000002
2013-10-31 16:20:25,131 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000003_0' to tip task_20131031160444934_0035_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:25,131 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000003
2013-10-31 16:20:25,133 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:20:25,134 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:20:25,134 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000002_0 which needs 1 slots
2013-10-31 16:20:25,135 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000002_0 which needs 1 slots
2013-10-31 16:20:25,135 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000003_0 which needs 1 slots
2013-10-31 16:20:25,135 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0035_m_000003_0 which needs 1 slots
2013-10-31 16:20:25,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken dst=null perm=null
2013-10-31 16:20:25,144 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56798, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8369650424871952839_1409, duration: 293484
2013-10-31 16:20:25,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml dst=null perm=null
2013-10-31 16:20:25,151 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36764, bytes: 27827, op: HDFS_READ, cliID: DFSClient_-997578610, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6784548083507528066_1406, duration: 160380
2013-10-31 16:20:25,154 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-930299698
2013-10-31 16:20:25,154 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-930299698 spawned.
2013-10-31 16:20:25,155 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0035/attempt_20131031160444934_0035_m_000001_0. Attempting to reuse: jvm_20131031160444934_0035_m_-234810922
2013-10-31 16:20:25,156 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000000_0/taskjvm.sh
2013-10-31 16:20:25,164 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:25,173 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0035_m_000004_0' to tip task_20131031160444934_0035_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:25,173 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0035_m_000004
2013-10-31 16:20:25,174 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:20:25,175 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:25,175 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000004_0 which needs 1 slots
2013-10-31 16:20:25,175 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:25,175 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:25,175 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000004_0 which needs 1 slots
2013-10-31 16:20:25,175 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0034_m_-112746602 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:25,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar dst=null perm=null
2013-10-31 16:20:25,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035/jobToken dst=null perm=null
2013-10-31 16:20:25,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56801, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-997578610, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-829965190113103341_1403, duration: 633392
2013-10-31 16:20:25,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36697, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8369650424871952839_1409, duration: 112592
2013-10-31 16:20:25,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.xml dst=null perm=null
2013-10-31 16:20:25,183 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36699, bytes: 27827, op: HDFS_READ, cliID: DFSClient_751365490, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6784548083507528066_1406, duration: 150037
2013-10-31 16:20:25,195 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:25,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.jar dst=null perm=null
2013-10-31 16:20:25,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49802, bytes: 239915, op: HDFS_READ, cliID: DFSClient_751365490, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-829965190113103341_1403, duration: 654064
2013-10-31 16:20:25,233 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-647659629
2013-10-31 16:20:25,233 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-647659629 spawned.
2013-10-31 16:20:25,235 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000003_0/taskjvm.sh
2013-10-31 16:20:25,236 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-1752688732
2013-10-31 16:20:25,236 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-1752688732 spawned.
2013-10-31 16:20:25,237 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000002_0/taskjvm.sh
2013-10-31 16:20:25,273 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_-356651926
2013-10-31 16:20:25,275 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_-356651926 spawned.
2013-10-31 16:20:25,277 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000004_0/taskjvm.sh
2013-10-31 16:20:25,562 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-234810922 given task: attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:25,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=null
2013-10-31 16:20:25,680 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36771, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4490428191685297632_1404, duration: 165753
2013-10-31 16:20:25,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:25,721 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49805, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 100029
2013-10-31 16:20:26,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:26,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:26,626 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001. blk_8838296772880953227_1410
2013-10-31 16:20:26,644 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838296772880953227_1410 src: /127.0.0.1:49806 dest: /127.0.0.1:47311
2013-10-31 16:20:26,645 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838296772880953227_1410 src: /127.0.0.1:36774 dest: /127.0.0.1:38271
2013-10-31 16:20:26,646 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8838296772880953227_1410 src: /127.0.0.1:36707 dest: /127.0.0.1:50942
2013-10-31 16:20:26,648 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36707, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8838296772880953227_1410, duration: 1295433
2013-10-31 16:20:26,648 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8838296772880953227_1410 terminating
2013-10-31 16:20:26,648 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36774, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8838296772880953227_1410, duration: 1766577
2013-10-31 16:20:26,649 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8838296772880953227_1410 terminating
2013-10-31 16:20:26,649 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49806, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8838296772880953227_1410, duration: 2174307
2013-10-31 16:20:26,649 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8838296772880953227_1410 terminating
2013-10-31 16:20:26,650 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8838296772880953227_1410 size 8
2013-10-31 16:20:26,651 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:26,651 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:26,652 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8838296772880953227_1410 size 8
2013-10-31 16:20:26,653 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8838296772880953227_1410 size 8
2013-10-31 16:20:26,688 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:26,688 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000001_0 0.0%
2013-10-31 16:20:27,195 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-356651926 given task: attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:27,197 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-647659629 given task: attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:27,208 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-1752688732 given task: attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:27,209 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_-930299698 given task: attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:27,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=null
2013-10-31 16:20:27,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=null
2013-10-31 16:20:27,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=null
2013-10-31 16:20:27,708 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56821, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4490428191685297632_1404, duration: 169058
2013-10-31 16:20:27,708 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36717, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4490428191685297632_1404, duration: 144331
2013-10-31 16:20:27,709 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49820, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4490428191685297632_1404, duration: 142307
2013-10-31 16:20:27,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035/job.split dst=null perm=null
2013-10-31 16:20:27,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36719, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4490428191685297632_1404, duration: 161867
2013-10-31 16:20:27,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:27,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:27,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:27,748 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49822, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 114004
2013-10-31 16:20:27,749 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36790, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 113341
2013-10-31 16:20:27,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:27,767 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49824, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 145340
2013-10-31 16:20:27,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:27,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:27,951 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36792, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 131512
2013-10-31 16:20:27,957 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000. blk_823550070109523503_1414
2013-10-31 16:20:27,957 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002. blk_-3412652135579097293_1414
2013-10-31 16:20:27,959 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003. blk_4361770873798175822_1414
2013-10-31 16:20:27,967 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004. blk_-3428262924556753517_1414
2013-10-31 16:20:27,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_823550070109523503_1414 src: /127.0.0.1:36793 dest: /127.0.0.1:38271
2013-10-31 16:20:27,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3412652135579097293_1414 src: /127.0.0.1:36794 dest: /127.0.0.1:38271
2013-10-31 16:20:27,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_823550070109523503_1414 src: /127.0.0.1:56833 dest: /127.0.0.1:41648
2013-10-31 16:20:27,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3412652135579097293_1414 src: /127.0.0.1:36729 dest: /127.0.0.1:50942
2013-10-31 16:20:27,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_823550070109523503_1414 src: /127.0.0.1:49833 dest: /127.0.0.1:47311
2013-10-31 16:20:27,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3412652135579097293_1414 src: /127.0.0.1:56835 dest: /127.0.0.1:41648
2013-10-31 16:20:27,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3428262924556753517_1414 src: /127.0.0.1:36727 dest: /127.0.0.1:50942
2013-10-31 16:20:27,992 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56835, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3412652135579097293_1414, duration: 3519876
2013-10-31 16:20:27,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4361770873798175822_1414 src: /127.0.0.1:36726 dest: /127.0.0.1:50942
2013-10-31 16:20:27,992 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3412652135579097293_1414 terminating
2013-10-31 16:20:27,992 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49833, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_823550070109523503_1414, duration: 5067011
2013-10-31 16:20:27,994 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3412652135579097293_1414 size 8
2013-10-31 16:20:27,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3428262924556753517_1414 src: /127.0.0.1:49834 dest: /127.0.0.1:47311
2013-10-31 16:20:27,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4361770873798175822_1414 src: /127.0.0.1:49835 dest: /127.0.0.1:47311
2013-10-31 16:20:27,994 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_823550070109523503_1414 size 8
2013-10-31 16:20:27,993 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36729, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3412652135579097293_1414, duration: 5355985
2013-10-31 16:20:27,994 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56833, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_823550070109523503_1414, duration: 7246876
2013-10-31 16:20:27,994 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_823550070109523503_1414 terminating
2013-10-31 16:20:27,996 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_823550070109523503_1414 terminating
2013-10-31 16:20:27,996 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36794, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 8408886
2013-10-31 16:20:27,997 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36793, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_823550070109523503_1414, duration: 8593221
2013-10-31 16:20:27,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3428262924556753517_1414 src: /127.0.0.1:36803 dest: /127.0.0.1:38271
2013-10-31 16:20:27,997 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_823550070109523503_1414 terminating
2013-10-31 16:20:27,996 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_823550070109523503_1414 size 8
2013-10-31 16:20:27,996 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3412652135579097293_1414 terminating
2013-10-31 16:20:27,997 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:27,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4361770873798175822_1414 src: /127.0.0.1:36804 dest: /127.0.0.1:38271
2013-10-31 16:20:27,997 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3412652135579097293_1414 terminating
2013-10-31 16:20:28,001 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:28,002 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:28,002 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36803, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3428262924556753517_1414, duration: 2048585
2013-10-31 16:20:28,004 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:28,004 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3428262924556753517_1414 terminating
2013-10-31 16:20:28,004 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3412652135579097293_1414 size 8
2013-10-31 16:20:28,005 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49834, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3428262924556753517_1414, duration: 3165766
2013-10-31 16:20:28,005 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36804, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4361770873798175822_1414, duration: 351961
2013-10-31 16:20:28,005 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3412652135579097293_1414 size 8
2013-10-31 16:20:28,005 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4361770873798175822_1414 terminating
2013-10-31 16:20:28,005 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3428262924556753517_1414 terminating
2013-10-31 16:20:28,005 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_823550070109523503_1414 size 8
2013-10-31 16:20:28,005 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36727, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3428262924556753517_1414, duration: 5005587
2013-10-31 16:20:28,005 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3428262924556753517_1414 size 8
2013-10-31 16:20:28,006 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3428262924556753517_1414 terminating
2013-10-31 16:20:28,006 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3428262924556753517_1414 size 8
2013-10-31 16:20:28,006 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49835, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4361770873798175822_1414, duration: 736795
2013-10-31 16:20:28,006 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4361770873798175822_1414 size 8
2013-10-31 16:20:28,006 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4361770873798175822_1414 terminating
2013-10-31 16:20:28,006 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3428262924556753517_1414 size 8
2013-10-31 16:20:28,007 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36726, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0035_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4361770873798175822_1414, duration: 2003694
2013-10-31 16:20:28,007 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4361770873798175822_1414 size 8
2013-10-31 16:20:28,007 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4361770873798175822_1414 terminating
2013-10-31 16:20:28,007 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4361770873798175822_1414 size 8
2013-10-31 16:20:28,007 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:28,008 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:28,008 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:28,008 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:28,076 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:28,076 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000002_0 0.0%
2013-10-31 16:20:28,103 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000001_0
2013-10-31 16:20:28,137 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000002_0
2013-10-31 16:20:30,100 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0035_m_000006_0
2013-10-31 16:20:30,100 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0035_m_000006_0
2013-10-31 16:20:30,101 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000006_0 not found in cache
2013-10-31 16:20:30,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0 dst=null perm=null
2013-10-31 16:20:30,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0 dst=null perm=null
2013-10-31 16:20:30,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:30,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:30,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:30,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:30,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000002_0 dst=null perm=null
2013-10-31 16:20:30,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000001_0 dst=null perm=null
2013-10-31 16:20:30,361 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:30,361 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:30,361 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0035_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:30,361 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000000_0 0.0%
2013-10-31 16:20:30,361 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000003_0 0.0%
2013-10-31 16:20:30,361 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000004_0 0.0%
2013-10-31 16:20:30,634 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:20:30,635 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000002_0 is done.
2013-10-31 16:20:30,636 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000002_0 was -1
2013-10-31 16:20:30,636 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:31,107 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000000_0
2013-10-31 16:20:31,140 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000002_0' has completed task_20131031160444934_0035_m_000002 successfully.
2013-10-31 16:20:31,142 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000003_0
2013-10-31 16:20:31,183 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0035_m_000004_0
2013-10-31 16:20:31,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0 dst=null perm=null
2013-10-31 16:20:31,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0 dst=null perm=null
2013-10-31 16:20:31,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0 dst=null perm=null
2013-10-31 16:20:31,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:31,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:31,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:31,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:31,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:31,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:31,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000003_0 dst=null perm=null
2013-10-31 16:20:31,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000004_0 dst=null perm=null
2013-10-31 16:20:31,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary/_attempt_20131031160444934_0035_m_000000_0 dst=null perm=null
2013-10-31 16:20:31,689 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:31,693 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:31,695 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000001_0 is done.
2013-10-31 16:20:31,695 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000001_0 was -1
2013-10-31 16:20:31,695 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:33,684 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:33,685 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:33,686 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:33,686 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:33,687 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000000_0 is done.
2013-10-31 16:20:33,687 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000000_0 was -1
2013-10-31 16:20:33,687 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000003_0 is done.
2013-10-31 16:20:33,687 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:33,687 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000003_0 was -1
2013-10-31 16:20:33,687 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:33,693 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:33,695 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:33,696 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000004_0 is done.
2013-10-31 16:20:33,696 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000004_0 was -1
2013-10-31 16:20:33,696 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:34,111 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000000_0' has completed task_20131031160444934_0035_m_000000 successfully.
2013-10-31 16:20:34,112 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000001_0' has completed task_20131031160444934_0035_m_000001 successfully.
2013-10-31 16:20:34,145 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000003_0' has completed task_20131031160444934_0035_m_000003 successfully.
2013-10-31 16:20:34,185 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000004_0' has completed task_20131031160444934_0035_m_000004 successfully.
2013-10-31 16:20:34,188 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0035_m_000005_0' to tip task_20131031160444934_0035_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:34,191 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0035_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:20:34,191 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0035_m_000005_0 which needs 1 slots
2013-10-31 16:20:34,191 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0035_m_000005_0 which needs 1 slots
2013-10-31 16:20:34,229 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0035_m_877611637
2013-10-31 16:20:34,229 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0035_m_877611637 spawned.
2013-10-31 16:20:34,231 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0035/attempt_20131031160444934_0035_m_000005_0/taskjvm.sh
2013-10-31 16:20:35,168 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0035_m_877611637 given task: attempt_20131031160444934_0035_m_000005_0
2013-10-31 16:20:35,645 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000005_0 0.0%
2013-10-31 16:20:35,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary dst=null perm=null
2013-10-31 16:20:35,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:35,666 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_SUCCESS from client DFSClient_attempt_20131031160444934_0035_m_000005_0
2013-10-31 16:20:35,666 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0035_m_000005_0
2013-10-31 16:20:35,674 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,674 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:35,674 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:35,675 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-829965190113103341 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,675 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:35,675 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,675 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:35,675 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4490428191685297632 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,675 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4927569461534459951 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:35,676 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4927569461534459951 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,676 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4927569461534459951 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,676 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6784548083507528066 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:35,676 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6784548083507528066 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:35,676 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6784548083507528066 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:35,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0035 dst=null perm=null
2013-10-31 16:20:36,368 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_4927569461534459951_1405 blk_6784548083507528066_1406 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:36,369 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_4927569461534459951_1405 blk_6784548083507528066_1406 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:38,581 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0035_m_000005_0 0.0% cleanup
2013-10-31 16:20:38,583 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0035_m_000005_0 is done.
2013-10-31 16:20:38,583 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0035_m_000005_0 was -1
2013-10-31 16:20:38,583 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:38,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data1/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:38,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data2/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:38,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data1/current/blk_-829965190113103341
2013-10-31 16:20:38,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data2/current/blk_4490428191685297632
2013-10-31 16:20:38,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4927569461534459951_1405 file build/test/data/dfs/data/data1/current/blk_4927569461534459951 for deletion
2013-10-31 16:20:38,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6784548083507528066_1406 file build/test/data/dfs/data/data2/current/blk_6784548083507528066 for deletion
2013-10-31 16:20:38,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4927569461534459951_1405 at file build/test/data/dfs/data/data1/current/blk_4927569461534459951
2013-10-31 16:20:38,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6784548083507528066_1406 at file build/test/data/dfs/data/data2/current/blk_6784548083507528066
2013-10-31 16:20:39,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data8/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:39,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data7/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:39,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4927569461534459951_1405 file build/test/data/dfs/data/data8/current/blk_4927569461534459951 for deletion
2013-10-31 16:20:39,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data7/current/blk_4490428191685297632
2013-10-31 16:20:39,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6784548083507528066_1406 file build/test/data/dfs/data/data7/current/blk_6784548083507528066 for deletion
2013-10-31 16:20:39,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data8/current/blk_-829965190113103341
2013-10-31 16:20:39,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6784548083507528066_1406 at file build/test/data/dfs/data/data7/current/blk_6784548083507528066
2013-10-31 16:20:39,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4927569461534459951_1405 at file build/test/data/dfs/data/data8/current/blk_4927569461534459951
2013-10-31 16:20:39,369 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_4927569461534459951_1405 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:39,369 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_6784548083507528066_1406 blk_4490428191685297632_1404 blk_-829965190113103341_1403
2013-10-31 16:20:39,541 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data4/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:39,541 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data3/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:39,541 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data4/current/blk_-829965190113103341
2013-10-31 16:20:39,542 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data3/current/blk_4490428191685297632
2013-10-31 16:20:39,541 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6784548083507528066_1406 file build/test/data/dfs/data/data4/current/blk_6784548083507528066 for deletion
2013-10-31 16:20:39,542 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6784548083507528066_1406 at file build/test/data/dfs/data/data4/current/blk_6784548083507528066
2013-10-31 16:20:39,847 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:20:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,870 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,881 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,886 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:20:39,892 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:20:40,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-829965190113103341_1403 file build/test/data/dfs/data/data6/current/blk_-829965190113103341 for deletion
2013-10-31 16:20:40,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4490428191685297632_1404 file build/test/data/dfs/data/data5/current/blk_4490428191685297632 for deletion
2013-10-31 16:20:40,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-829965190113103341_1403 at file build/test/data/dfs/data/data6/current/blk_-829965190113103341
2013-10-31 16:20:40,159 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4490428191685297632_1404 at file build/test/data/dfs/data/data5/current/blk_4490428191685297632
2013-10-31 16:20:40,159 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4927569461534459951_1405 file build/test/data/dfs/data/data6/current/blk_4927569461534459951 for deletion
2013-10-31 16:20:40,159 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4927569461534459951_1405 at file build/test/data/dfs/data/data6/current/blk_4927569461534459951
2013-10-31 16:20:40,199 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0035_m_000005_0' has completed task_20131031160444934_0035_m_000005 successfully.
2013-10-31 16:20:40,200 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0035 has completed successfully.
2013-10-31 16:20:40,200 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0035,submitTime=1383236417025,launchTime=1383236417613,firstMapTaskLaunchTime=1383236425094,firstJobSetupTaskLaunchTime=1383236419077,firstJobCleanupTaskLaunchTime=1383236434188,finishTime=1383236440200,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[6ABABDE7E439464AABFBD12003752CA1/237A17A3D2174464839B014948A9A81D] lower/(1/1) ...edpipesplatform/samepipe2
2013-10-31 16:20:40,208 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464. blk_-1006260212807991529_1415
2013-10-31 16:20:40,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1006260212807991529_1415 src: /127.0.0.1:36743 dest: /127.0.0.1:50942
2013-10-31 16:20:40,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1006260212807991529_1415 src: /127.0.0.1:49846 dest: /127.0.0.1:47311
2013-10-31 16:20:40,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1006260212807991529_1415 src: /127.0.0.1:56850 dest: /127.0.0.1:41648
2013-10-31 16:20:40,224 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56850, dest: /127.0.0.1:41648, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1006260212807991529_1415, duration: 6706778
2013-10-31 16:20:40,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1006260212807991529_1415 terminating
2013-10-31 16:20:40,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49846, dest: /127.0.0.1:47311, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1006260212807991529_1415, duration: 6675067
2013-10-31 16:20:40,225 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1006260212807991529_1415 terminating
2013-10-31 16:20:40,226 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1006260212807991529_1415 size 26335
2013-10-31 16:20:40,226 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36743, dest: /127.0.0.1:50942, bytes: 26335, op: HDFS_WRITE, cliID: DFSClient_-604205094, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1006260212807991529_1415, duration: 6521641
2013-10-31 16:20:40,226 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1006260212807991529_1415 terminating
2013-10-31 16:20:40,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1006260212807991529_1415 size 26335
2013-10-31 16:20:40,230 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464 from client DFSClient_-604205094
2013-10-31 16:20:40,230 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_logs/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464 is closed by DFSClient_-604205094
2013-10-31 16:20:40,231 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1006260212807991529_1415 size 26335
2013-10-31 16:20:40,742 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0035_1383236417025_hadoop_%5B6ABABDE7E439464AABFBD12003752CA1%2F237A17A3D2174464 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:40,743 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000004_0'
2013-10-31 16:20:40,743 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000005_0'
2013-10-31 16:20:40,745 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8369650424871952839 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:40,745 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8369650424871952839 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:40,746 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:40,746 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8369650424871952839 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:40,746 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0035 being deleted.
2013-10-31 16:20:40,748 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0035_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:20:40,751 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/_temporary
2013-10-31 16:20:40,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0035 dst=null perm=null
2013-10-31 16:20:40,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=null
2013-10-31 16:20:40,808 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:40,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null
2013-10-31 16:20:40,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001 dst=null perm=null
2013-10-31 16:20:40,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002 dst=null perm=null
2013-10-31 16:20:40,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003 dst=null perm=null
2013-10-31 16:20:40,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004 dst=null perm=null
2013-10-31 16:20:40,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null
2013-10-31 16:20:40,816 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56852, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_823550070109523503_1414, duration: 286480
2013-10-31 16:20:40,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001 dst=null perm=null
2013-10-31 16:20:40,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36748, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8838296772880953227_1410, duration: 264060
2013-10-31 16:20:40,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002 dst=null perm=null
2013-10-31 16:20:40,820 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36818, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 262427
2013-10-31 16:20:40,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003 dst=null perm=null
2013-10-31 16:20:40,822 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36750, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4361770873798175822_1414, duration: 257731
2013-10-31 16:20:40,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004 dst=null perm=null
2013-10-31 16:20:40,824 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36751, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3428262924556753517_1414, duration: 258892
2013-10-31 16:20:40,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=null
2013-10-31 16:20:40,832 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:20:40,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null
2013-10-31 16:20:40,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001 dst=null perm=null
2013-10-31 16:20:40,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002 dst=null perm=null
2013-10-31 16:20:40,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003 dst=null perm=null
2013-10-31 16:20:40,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004 dst=null perm=null
2013-10-31 16:20:40,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null
2013-10-31 16:20:40,839 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49854, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_823550070109523503_1414, duration: 146841
2013-10-31 16:20:40,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001 dst=null perm=null
2013-10-31 16:20:40,841 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49855, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8838296772880953227_1410, duration: 104959
2013-10-31 16:20:40,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002 dst=null perm=null
2013-10-31 16:20:40,843 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36823, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 109454
2013-10-31 16:20:40,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003 dst=null perm=null
2013-10-31 16:20:40,844 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36824, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4361770873798175822_1414, duration: 104724
2013-10-31 16:20:40,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004 dst=null perm=null
2013-10-31 16:20:40,846 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36825, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3428262924556753517_1414, duration: 102724
2013-10-31 16:20:40,846 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipe2
2013-10-31 16:20:40,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2 dst=null perm=null
2013-10-31 16:20:40,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00000 dst=null perm=null
2013-10-31 16:20:40,851 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36826, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_823550070109523503_1414, duration: 114664
2013-10-31 16:20:40,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00001 dst=null perm=null
2013-10-31 16:20:40,853 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49860, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8838296772880953227_1410, duration: 104420
2013-10-31 16:20:40,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00002 dst=null perm=null
2013-10-31 16:20:40,855 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36828, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3412652135579097293_1414, duration: 105831
2013-10-31 16:20:40,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00003 dst=null perm=null
2013-10-31 16:20:40,857 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36760, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4361770873798175822_1414, duration: 102247
2013-10-31 16:20:40,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe2/part-00004 dst=null perm=null
2013-10-31 16:20:40,860 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36830, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3428262924556753517_1414, duration: 101178
2013-10-31 16:20:40,873 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:20:40,874 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:20:40,888 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs] starting
2013-10-31 16:20:40,888 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs] source: Hfs["TextDelimited[['num', 'char']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:20:40,889 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3"]
2013-10-31 16:20:40,889 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs] parallel execution is enabled: true
2013-10-31 16:20:40,889 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs] starting jobs: 1
2013-10-31 16:20:40,890 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lhs] allocating threads: 1
2013-10-31 16:20:40,891 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs] starting step: (1/1) ...edpipesplatform/samepipe3
2013-10-31 16:20:40,894 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:20:40,894 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:20:40,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:40,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:20:40,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:40,933 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar. blk_-5817354174245219485_1416
2013-10-31 16:20:40,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:49864 dest: /127.0.0.1:47311
2013-10-31 16:20:40,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:36832 dest: /127.0.0.1:38271
2013-10-31 16:20:40,939 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:36764 dest: /127.0.0.1:50942
2013-10-31 16:20:40,946 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36764, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5817354174245219485_1416, duration: 3597155
2013-10-31 16:20:40,946 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5817354174245219485_1416 terminating
2013-10-31 16:20:40,947 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36832, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5817354174245219485_1416, duration: 5005320
2013-10-31 16:20:40,947 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5817354174245219485_1416 terminating
2013-10-31 16:20:40,948 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49864, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5817354174245219485_1416, duration: 5422965
2013-10-31 16:20:40,948 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5817354174245219485_1416 terminating
2013-10-31 16:20:40,950 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:40,950 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar from client DFSClient_1457307213
2013-10-31 16:20:40,951 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar is closed by DFSClient_1457307213
2013-10-31 16:20:40,951 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:40,952 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:40,961 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar. New replication is 10
2013-10-31 16:20:40,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar dst=null perm=null
2013-10-31 16:20:40,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:40,979 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:20:40,983 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:20:40,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:40,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,005 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split. New replication is 10
2013-10-31 16:20:41,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=null
2013-10-31 16:20:41,012 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split. blk_3223268501587367091_1417
2013-10-31 16:20:41,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:36834 dest: /127.0.0.1:38271
2013-10-31 16:20:41,016 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:49868 dest: /127.0.0.1:47311
2013-10-31 16:20:41,017 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:36767 dest: /127.0.0.1:50942
2013-10-31 16:20:41,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3223268501587367091_1417 src: /127.0.0.1:56873 dest: /127.0.0.1:41648
2013-10-31 16:20:41,022 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56873, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3223268501587367091_1417, duration: 1594024
2013-10-31 16:20:41,023 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,023 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36767, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 1052361
2013-10-31 16:20:41,024 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,024 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49868, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3223268501587367091_1417, duration: 1911216
2013-10-31 16:20:41,024 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,025 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36834, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3223268501587367091_1417, duration: 3210186
2013-10-31 16:20:41,025 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3223268501587367091_1417 terminating
2013-10-31 16:20:41,028 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,029 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split from client DFSClient_1457307213
2013-10-31 16:20:41,029 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split is closed by DFSClient_1457307213
2013-10-31 16:20:41,029 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,030 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,030 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3223268501587367091_1417 size 1732
2013-10-31 16:20:41,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,053 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo. blk_1039536471123630660_1418
2013-10-31 16:20:41,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1039536471123630660_1418 src: /127.0.0.1:56874 dest: /127.0.0.1:41648
2013-10-31 16:20:41,056 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1039536471123630660_1418 src: /127.0.0.1:49872 dest: /127.0.0.1:47311
2013-10-31 16:20:41,058 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1039536471123630660_1418 src: /127.0.0.1:36840 dest: /127.0.0.1:38271
2013-10-31 16:20:41,061 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36840, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1039536471123630660_1418, duration: 64201
2013-10-31 16:20:41,061 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1039536471123630660_1418 terminating
2013-10-31 16:20:41,061 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49872, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1039536471123630660_1418, duration: 848077
2013-10-31 16:20:41,062 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1039536471123630660_1418 terminating
2013-10-31 16:20:41,062 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56874, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1039536471123630660_1418, duration: 1655389
2013-10-31 16:20:41,063 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1039536471123630660_1418 terminating
2013-10-31 16:20:41,067 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1039536471123630660_1418 size 183
2013-10-31 16:20:41,068 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:20:41,068 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:20:41,068 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1039536471123630660_1418 size 183
2013-10-31 16:20:41,069 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1039536471123630660_1418 size 183
2013-10-31 16:20:41,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:41,100 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml. blk_-8990161524735521721_1419
2013-10-31 16:20:41,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8990161524735521721_1419 src: /127.0.0.1:56877 dest: /127.0.0.1:41648
2013-10-31 16:20:41,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8990161524735521721_1419 src: /127.0.0.1:36773 dest: /127.0.0.1:50942
2013-10-31 16:20:41,105 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8990161524735521721_1419 src: /127.0.0.1:36843 dest: /127.0.0.1:38271
2013-10-31 16:20:41,108 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36843, dest: /127.0.0.1:38271, bytes: 27785, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8990161524735521721_1419, duration: 177498
2013-10-31 16:20:41,109 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8990161524735521721_1419 terminating
2013-10-31 16:20:41,109 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36773, dest: /127.0.0.1:50942, bytes: 27785, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8990161524735521721_1419, duration: 988231
2013-10-31 16:20:41,109 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8990161524735521721_1419 terminating
2013-10-31 16:20:41,110 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56877, dest: /127.0.0.1:41648, bytes: 27785, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8990161524735521721_1419, duration: 1937245
2013-10-31 16:20:41,110 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8990161524735521721_1419 terminating
2013-10-31 16:20:41,113 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8990161524735521721_1419 size 27785
2013-10-31 16:20:41,113 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml from client DFSClient_1457307213
2013-10-31 16:20:41,114 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml is closed by DFSClient_1457307213
2013-10-31 16:20:41,114 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-8990161524735521721_1419 size 27785
2013-10-31 16:20:41,115 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8990161524735521721_1419 size 27785
2013-10-31 16:20:41,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml dst=null perm=null
2013-10-31 16:20:41,131 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36845, bytes: 28005, op: HDFS_READ, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8990161524735521721_1419, duration: 467054
2013-10-31 16:20:41,148 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0036: nMaps=5 nReduces=0 max=-1
2013-10-31 16:20:41,149 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0036 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:20:41,149 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0036 RESULT=SUCCESS
2013-10-31 16:20:41,149 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0036
2013-10-31 16:20:41,149 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0036
2013-10-31 16:20:41,149 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lhs] submitted hadoop job: job_20131031160444934_0036
2013-10-31 16:20:42,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:42,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:42,046 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml. blk_-3248233357626245067_1421
2013-10-31 16:20:42,048 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3248233357626245067_1421 src: /127.0.0.1:36846 dest: /127.0.0.1:38271
2013-10-31 16:20:42,049 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3248233357626245067_1421 src: /127.0.0.1:56883 dest: /127.0.0.1:41648
2013-10-31 16:20:42,051 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3248233357626245067_1421 src: /127.0.0.1:36779 dest: /127.0.0.1:50942
2013-10-31 16:20:42,055 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36779, dest: /127.0.0.1:50942, bytes: 27850, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3248233357626245067_1421, duration: 626786
2013-10-31 16:20:42,056 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3248233357626245067_1421 terminating
2013-10-31 16:20:42,056 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3248233357626245067_1421 size 27850
2013-10-31 16:20:42,056 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56883, dest: /127.0.0.1:41648, bytes: 27850, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3248233357626245067_1421, duration: 1479704
2013-10-31 16:20:42,057 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3248233357626245067_1421 terminating
2013-10-31 16:20:42,057 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36846, dest: /127.0.0.1:38271, bytes: 27850, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3248233357626245067_1421, duration: 2583900
2013-10-31 16:20:42,058 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3248233357626245067_1421 terminating
2013-10-31 16:20:42,059 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3248233357626245067_1421 size 27850
2013-10-31 16:20:42,059 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml from client DFSClient_-1735618845
2013-10-31 16:20:42,060 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_conf.xml is closed by DFSClient_-1735618845
2013-10-31 16:20:42,060 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3248233357626245067_1421 size 27850
2013-10-31 16:20:42,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:42,079 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken. blk_-8553465570091622260_1422
2013-10-31 16:20:42,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8553465570091622260_1422 src: /127.0.0.1:56885 dest: /127.0.0.1:41648
2013-10-31 16:20:42,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8553465570091622260_1422 src: /127.0.0.1:36850 dest: /127.0.0.1:38271
2013-10-31 16:20:42,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8553465570091622260_1422 src: /127.0.0.1:49884 dest: /127.0.0.1:47311
2013-10-31 16:20:42,087 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49884, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8553465570091622260_1422, duration: 62948
2013-10-31 16:20:42,089 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8553465570091622260_1422 terminating
2013-10-31 16:20:42,089 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36850, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8553465570091622260_1422, duration: 3215968
2013-10-31 16:20:42,090 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8553465570091622260_1422 terminating
2013-10-31 16:20:42,090 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56885, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8553465570091622260_1422, duration: 4172546
2013-10-31 16:20:42,091 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-8553465570091622260_1422 size 116
2013-10-31 16:20:42,092 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8553465570091622260_1422 terminating
2013-10-31 16:20:42,093 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-8553465570091622260_1422 size 116
2013-10-31 16:20:42,093 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken from client DFSClient_1457307213
2013-10-31 16:20:42,094 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken is closed by DFSClient_1457307213
2013-10-31 16:20:42,094 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-8553465570091622260_1422 size 116
2013-10-31 16:20:42,100 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken
2013-10-31 16:20:42,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.splitmetainfo dst=null perm=null
2013-10-31 16:20:42,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56888, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1039536471123630660_1418, duration: 280061
2013-10-31 16:20:42,106 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0036 = 19. Number of splits = 5
2013-10-31 16:20:42,106 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,106 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,107 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,108 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0036_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:20:42,109 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0036 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:20:42,110 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0036 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:20:42,370 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:38271 to replicate blk_-5817354174245219485_1416 to datanode(s) 127.0.0.1:41648
2013-10-31 16:20:42,370 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8369650424871952839_1409
2013-10-31 16:20:42,370 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-8369650424871952839_1409
2013-10-31 16:20:43,126 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0036_m_000006_0' to tip task_20131031160444934_0036_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:43,130 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000000_0'
2013-10-31 16:20:43,131 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000001_0'
2013-10-31 16:20:43,131 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000006_0'
2013-10-31 16:20:43,133 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:20:43,133 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000006_0 which needs 1 slots
2013-10-31 16:20:43,133 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000006_0 which needs 1 slots
2013-10-31 16:20:43,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken dst=null perm=null
2013-10-31 16:20:43,142 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56889, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8553465570091622260_1422, duration: 299437
2013-10-31 16:20:43,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml dst=null perm=null
2013-10-31 16:20:43,152 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56891, bytes: 28005, op: HDFS_READ, cliID: DFSClient_582461285, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8990161524735521721_1419, duration: 373095
2013-10-31 16:20:43,159 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000002_0'
2013-10-31 16:20:43,159 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0035_m_000003_0'
2013-10-31 16:20:43,159 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8369650424871952839_1409 file build/test/data/dfs/data/data6/current/blk_-8369650424871952839 for deletion
2013-10-31 16:20:43,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8369650424871952839_1409 at file build/test/data/dfs/data/data6/current/blk_-8369650424871952839
2013-10-31 16:20:43,181 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:43,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar dst=null perm=null
2013-10-31 16:20:43,214 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36787, bytes: 239915, op: HDFS_READ, cliID: DFSClient_582461285, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5817354174245219485_1416, duration: 1658540
2013-10-31 16:20:43,307 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0035_m_-930299698
2013-10-31 16:20:43,314 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32253 with signal TERM. Exit code 0
2013-10-31 16:20:43,314 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_-1374678209
2013-10-31 16:20:43,315 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_-1374678209 spawned.
2013-10-31 16:20:43,316 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000006_0/taskjvm.sh
2013-10-31 16:20:43,388 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:43,388 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:43,388 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:43,388 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-930299698 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:44,936 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1374678209 given task: attempt_20131031160444934_0036_m_000006_0
2013-10-31 16:20:44,942 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394) Starting thread to transfer block blk_-5817354174245219485_1416 to 127.0.0.1:41648
2013-10-31 16:20:44,944 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:38271, storageID=DS-799621837-10.5.128.102-38271-1383235481550, infoPort=57719, ipcPort=56394):Transmitted block blk_-5817354174245219485_1416 to /127.0.0.1:41648
2013-10-31 16:20:44,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5817354174245219485_1416 src: /127.0.0.1:56894 dest: /127.0.0.1:41648
2013-10-31 16:20:44,948 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5817354174245219485_1416 src: /127.0.0.1:56894 dest: /127.0.0.1:41648 of size 238055
2013-10-31 16:20:44,950 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5817354174245219485_1416 size 238055
2013-10-31 16:20:45,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8369650424871952839_1409 file build/test/data/dfs/data/data7/current/blk_-8369650424871952839 for deletion
2013-10-31 16:20:45,152 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8369650424871952839_1409 at file build/test/data/dfs/data/data7/current/blk_-8369650424871952839
2013-10-31 16:20:45,371 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-8369650424871952839_1409
2013-10-31 16:20:45,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:45,746 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:45,746 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000005_0 not found in cache
2013-10-31 16:20:45,746 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000004_0 not found in cache
2013-10-31 16:20:45,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0035 for user-log deletion with retainTimeStamp:1383322845747
2013-10-31 16:20:46,230 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-356651926 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:46,243 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32254 with signal TERM. Exit code 0
2013-10-31 16:20:46,429 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:46,429 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:46,430 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:46,430 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-356651926 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:46,649 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_877611637 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:46,658 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32555 with signal TERM. Exit code 0
2013-10-31 16:20:46,823 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:46,824 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:46,824 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:46,824 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_877611637 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:47,944 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8369650424871952839_1409 file build/test/data/dfs/data/data2/current/blk_-8369650424871952839 for deletion
2013-10-31 16:20:47,944 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8369650424871952839_1409 at file build/test/data/dfs/data/data2/current/blk_-8369650424871952839
2013-10-31 16:20:48,133 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:48,134 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000001_0 not found in cache
2013-10-31 16:20:48,134 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000000_0 not found in cache
2013-10-31 16:20:48,134 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0035 for user-log deletion with retainTimeStamp:1383322848134
2013-10-31 16:20:48,160 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0035
2013-10-31 16:20:48,160 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000002_0 not found in cache
2013-10-31 16:20:48,160 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0035_m_000003_0 not found in cache
2013-10-31 16:20:48,161 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0035 for user-log deletion with retainTimeStamp:1383322848160
2013-10-31 16:20:48,395 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000006_0 0.0% setup
2013-10-31 16:20:48,398 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000006_0 is done.
2013-10-31 16:20:48,398 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000006_0 was -1
2013-10-31 16:20:48,398 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:48,736 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-234810922 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:48,743 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32065 with signal TERM. Exit code 0
2013-10-31 16:20:48,943 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:48,943 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:48,943 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:48,944 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-234810922 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:20:49,139 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000006_0' has completed task_20131031160444934_0036_m_000006 successfully.
2013-10-31 16:20:49,143 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000000_0' to tip task_20131031160444934_0036_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:49,144 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000000
2013-10-31 16:20:49,144 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000001_0' to tip task_20131031160444934_0036_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:49,145 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000001
2013-10-31 16:20:49,147 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:20:49,148 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:20:49,148 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000000_0 which needs 1 slots
2013-10-31 16:20:49,148 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000000_0 which needs 1 slots
2013-10-31 16:20:49,149 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000001_0 which needs 1 slots
2013-10-31 16:20:49,149 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0036_m_000001_0 which needs 1 slots
2013-10-31 16:20:49,167 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000002_0' to tip task_20131031160444934_0036_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:49,167 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000002
2013-10-31 16:20:49,168 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000003_0' to tip task_20131031160444934_0036_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:55789'
2013-10-31 16:20:49,168 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000003
2013-10-31 16:20:49,170 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:20:49,171 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:20:49,172 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000002_0 which needs 1 slots
2013-10-31 16:20:49,172 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000002_0 which needs 1 slots
2013-10-31 16:20:49,172 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000003_0 which needs 1 slots
2013-10-31 16:20:49,173 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0036_m_000003_0 which needs 1 slots
2013-10-31 16:20:49,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken dst=null perm=null
2013-10-31 16:20:49,181 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36860, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-8553465570091622260_1422, duration: 300085
2013-10-31 16:20:49,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml dst=null perm=null
2013-10-31 16:20:49,189 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36793, bytes: 28005, op: HDFS_READ, cliID: DFSClient_-1807724398, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8990161524735521721_1419, duration: 158804
2013-10-31 16:20:49,191 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_-1410338411
2013-10-31 16:20:49,192 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_-1410338411 spawned.
2013-10-31 16:20:49,193 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0036/attempt_20131031160444934_0036_m_000000_0. Attempting to reuse: jvm_20131031160444934_0036_m_-1374678209
2013-10-31 16:20:49,193 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000001_0/taskjvm.sh
2013-10-31 16:20:49,201 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1374678209 given task: attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:49,209 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-1752688732 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:49,217 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32252 with signal TERM. Exit code 0
2013-10-31 16:20:49,221 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0035_m_-647659629 since job job_20131031160444934_0035 is dead
2013-10-31 16:20:49,234 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32251 with signal TERM. Exit code 0
2013-10-31 16:20:49,297 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:49,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=null
2013-10-31 16:20:49,308 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56900, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3223268501587367091_1417, duration: 168016
2013-10-31 16:20:49,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar dst=null perm=null
2013-10-31 16:20:49,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36796, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1807724398, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5817354174245219485_1416, duration: 622051
2013-10-31 16:20:49,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:49,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:49,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:49,387 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:49,388 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:49,388 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:49,388 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-1752688732 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:49,400 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:20:49,400 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:20:49,400 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:20:49,400 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0035_m_-647659629 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:20:49,406 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_764575079
2013-10-31 16:20:49,406 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_764575079 spawned.
2013-10-31 16:20:49,406 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_986697684
2013-10-31 16:20:49,407 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_986697684 spawned.
2013-10-31 16:20:49,408 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000002_0/taskjvm.sh
2013-10-31 16:20:49,408 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000003_0/taskjvm.sh
2013-10-31 16:20:49,636 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36866, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 127198
2013-10-31 16:20:49,643 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000. blk_1303671696596010570_1423
2013-10-31 16:20:49,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1303671696596010570_1423 src: /127.0.0.1:49900 dest: /127.0.0.1:47311
2013-10-31 16:20:49,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1303671696596010570_1423 src: /127.0.0.1:56904 dest: /127.0.0.1:41648
2013-10-31 16:20:49,718 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1303671696596010570_1423 src: /127.0.0.1:36800 dest: /127.0.0.1:50942
2013-10-31 16:20:49,735 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36800, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1303671696596010570_1423, duration: 16182776
2013-10-31 16:20:49,736 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1303671696596010570_1423 terminating
2013-10-31 16:20:49,736 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56904, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1303671696596010570_1423, duration: 16830990
2013-10-31 16:20:49,737 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1303671696596010570_1423 size 8
2013-10-31 16:20:49,737 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1303671696596010570_1423 terminating
2013-10-31 16:20:49,738 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49900, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1303671696596010570_1423, duration: 18324371
2013-10-31 16:20:49,738 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1303671696596010570_1423 terminating
2013-10-31 16:20:49,739 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1303671696596010570_1423 size 8
2013-10-31 16:20:49,740 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1303671696596010570_1423 size 8
2013-10-31 16:20:49,744 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:49,744 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:49,752 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0036_m_000004_0' to tip task_20131031160444934_0036_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:20:49,753 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0036_m_000004
2013-10-31 16:20:49,755 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:20:49,755 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000004_0 which needs 1 slots
2013-10-31 16:20:49,756 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000004_0 which needs 1 slots
2013-10-31 16:20:49,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036/jobToken dst=null perm=null
2013-10-31 16:20:49,763 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56906, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8553465570091622260_1422, duration: 270922
2013-10-31 16:20:49,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.xml dst=null perm=null
2013-10-31 16:20:49,770 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36803, bytes: 28005, op: HDFS_READ, cliID: DFSClient_-10811922, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-8990161524735521721_1419, duration: 164976
2013-10-31 16:20:49,784 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:49,785 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000000_0 0.0%
2013-10-31 16:20:49,791 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:20:49,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.jar dst=null perm=null
2013-10-31 16:20:49,805 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49906, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-10811922, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5817354174245219485_1416, duration: 592264
2013-10-31 16:20:49,856 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0036_m_-2008477174
2013-10-31 16:20:49,857 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0036_m_-2008477174 spawned.
2013-10-31 16:20:49,858 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0036/attempt_20131031160444934_0036_m_000004_0/taskjvm.sh
2013-10-31 16:20:50,116 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1410338411 given task: attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:50,510 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_764575079 given task: attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:50,528 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_986697684 given task: attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:50,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=null
2013-10-31 16:20:50,619 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49911, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3223268501587367091_1417, duration: 163941
2013-10-31 16:20:50,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:50,659 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36810, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 141134
2013-10-31 16:20:50,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:50,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:50,856 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001. blk_8735242422086387614_1424
2013-10-31 16:20:50,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8735242422086387614_1424 src: /127.0.0.1:56916 dest: /127.0.0.1:41648
2013-10-31 16:20:50,891 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8735242422086387614_1424 src: /127.0.0.1:36812 dest: /127.0.0.1:50942
2013-10-31 16:20:50,892 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8735242422086387614_1424 src: /127.0.0.1:36882 dest: /127.0.0.1:38271
2013-10-31 16:20:50,894 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36882, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8735242422086387614_1424, duration: 1133648
2013-10-31 16:20:50,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8735242422086387614_1424 terminating
2013-10-31 16:20:50,895 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8735242422086387614_1424 size 8
2013-10-31 16:20:50,895 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36812, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8735242422086387614_1424, duration: 1668647
2013-10-31 16:20:50,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8735242422086387614_1424 terminating
2013-10-31 16:20:50,895 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56916, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8735242422086387614_1424, duration: 2061573
2013-10-31 16:20:50,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8735242422086387614_1424 size 8
2013-10-31 16:20:50,896 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8735242422086387614_1424 terminating
2013-10-31 16:20:50,896 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:50,897 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:50,898 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8735242422086387614_1424 size 8
2013-10-31 16:20:50,951 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:50,951 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000001_0 0.0%
2013-10-31 16:20:51,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=null
2013-10-31 16:20:51,037 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36817, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 168791
2013-10-31 16:20:51,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=null
2013-10-31 16:20:51,044 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36818, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 146448
2013-10-31 16:20:51,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:51,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49921, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 115240
2013-10-31 16:20:51,079 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-2008477174 given task: attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:51,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:51,085 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49922, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 133084
2013-10-31 16:20:51,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:51,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:51,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:51,335 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002. blk_3563163408596565662_1426
2013-10-31 16:20:51,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3563163408596565662_1426 src: /127.0.0.1:56926 dest: /127.0.0.1:41648
2013-10-31 16:20:51,362 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3563163408596565662_1426 src: /127.0.0.1:36891 dest: /127.0.0.1:38271
2013-10-31 16:20:51,363 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3563163408596565662_1426 src: /127.0.0.1:36823 dest: /127.0.0.1:50942
2013-10-31 16:20:51,365 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36823, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3563163408596565662_1426, duration: 1075504
2013-10-31 16:20:51,365 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3563163408596565662_1426 terminating
2013-10-31 16:20:51,366 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36891, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3563163408596565662_1426, duration: 1432212
2013-10-31 16:20:51,366 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3563163408596565662_1426 terminating
2013-10-31 16:20:51,366 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3563163408596565662_1426 size 8
2013-10-31 16:20:51,366 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56926, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3563163408596565662_1426, duration: 1882477
2013-10-31 16:20:51,367 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3563163408596565662_1426 terminating
2013-10-31 16:20:51,367 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3563163408596565662_1426 size 8
2013-10-31 16:20:51,367 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:51,368 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:51,369 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3563163408596565662_1426 size 8
2013-10-31 16:20:51,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:51,523 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:51,523 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000002_0 0.0%
2013-10-31 16:20:51,643 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003. blk_-6798991363969057773_1426
2013-10-31 16:20:51,665 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6798991363969057773_1426 src: /127.0.0.1:36824 dest: /127.0.0.1:50942
2013-10-31 16:20:51,666 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6798991363969057773_1426 src: /127.0.0.1:56931 dest: /127.0.0.1:41648
2013-10-31 16:20:51,667 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6798991363969057773_1426 src: /127.0.0.1:49929 dest: /127.0.0.1:47311
2013-10-31 16:20:51,669 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49929, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6798991363969057773_1426, duration: 1125500
2013-10-31 16:20:51,670 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6798991363969057773_1426 terminating
2013-10-31 16:20:51,670 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56931, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6798991363969057773_1426, duration: 1504079
2013-10-31 16:20:51,670 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6798991363969057773_1426 terminating
2013-10-31 16:20:51,670 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36824, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6798991363969057773_1426, duration: 1888096
2013-10-31 16:20:51,670 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6798991363969057773_1426 terminating
2013-10-31 16:20:51,670 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6798991363969057773_1426 size 8
2013-10-31 16:20:51,671 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:51,671 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:51,673 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6798991363969057773_1426 size 8
2013-10-31 16:20:51,674 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6798991363969057773_1426 size 8
2013-10-31 16:20:51,719 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:51,720 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000003_0 0.0%
2013-10-31 16:20:51,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036/job.split dst=null perm=null
2013-10-31 16:20:51,737 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36828, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3223268501587367091_1417, duration: 163461
2013-10-31 16:20:51,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:20:51,776 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36898, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 256201
2013-10-31 16:20:51,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:51,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:51,984 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004. blk_-115642158726394487_1427
2013-10-31 16:20:52,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-115642158726394487_1427 src: /127.0.0.1:49932 dest: /127.0.0.1:47311
2013-10-31 16:20:52,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-115642158726394487_1427 src: /127.0.0.1:36900 dest: /127.0.0.1:38271
2013-10-31 16:20:52,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-115642158726394487_1427 src: /127.0.0.1:56937 dest: /127.0.0.1:41648
2013-10-31 16:20:52,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56937, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-115642158726394487_1427, duration: 1419748
2013-10-31 16:20:52,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-115642158726394487_1427 terminating
2013-10-31 16:20:52,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36900, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-115642158726394487_1427, duration: 1773077
2013-10-31 16:20:52,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-115642158726394487_1427 terminating
2013-10-31 16:20:52,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49932, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0036_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-115642158726394487_1427, duration: 2178708
2013-10-31 16:20:52,015 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-115642158726394487_1427 terminating
2013-10-31 16:20:52,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-115642158726394487_1427 size 8
2013-10-31 16:20:52,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-115642158726394487_1427 size 8
2013-10-31 16:20:52,018 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-115642158726394487_1427 size 8
2013-10-31 16:20:52,152 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000000_0
2013-10-31 16:20:52,152 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000001_0
2013-10-31 16:20:52,174 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000002_0
2013-10-31 16:20:52,174 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000003_0
2013-10-31 16:20:52,417 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:52,417 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:52,481 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0036_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:20:52,481 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000004_0 0.0%
2013-10-31 16:20:52,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0 dst=null perm=null
2013-10-31 16:20:52,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000002_0 dst=null perm=null
2013-10-31 16:20:52,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0 dst=null perm=null
2013-10-31 16:20:52,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000003_0 dst=null perm=null
2013-10-31 16:20:52,760 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0036_m_000004_0
2013-10-31 16:20:52,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0 dst=null perm=null
2013-10-31 16:20:52,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000000_0 dst=null perm=null
2013-10-31 16:20:52,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0 dst=null perm=null
2013-10-31 16:20:52,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:52,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:52,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000001_0 dst=null perm=null
2013-10-31 16:20:53,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0 dst=null perm=null
2013-10-31 16:20:53,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:20:53,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:53,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary/_attempt_20131031160444934_0036_m_000004_0 dst=null perm=null
2013-10-31 16:20:53,536 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:20:53,538 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000001_0 is done.
2013-10-31 16:20:53,538 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000001_0 was -1
2013-10-31 16:20:53,539 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:53,949 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:20:53,951 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000002_0 is done.
2013-10-31 16:20:53,951 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000002_0 was -1
2013-10-31 16:20:53,952 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:20:53,969 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:20:53,970 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000003_0 is done.
2013-10-31 16:20:53,970 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000003_0 was -1
2013-10-31 16:20:53,970 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:54,148 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0036_m_000006_0
2013-10-31 16:20:54,148 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0036_m_000006_0
2013-10-31 16:20:54,148 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000006_0 not found in cache
2013-10-31 16:20:54,667 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:20:54,669 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000004_0 is done.
2013-10-31 16:20:54,669 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000004_0 was -1
2013-10-31 16:20:54,669 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:55,155 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000001_0' has completed task_20131031160444934_0036_m_000001 successfully.
2013-10-31 16:20:55,178 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000002_0' has completed task_20131031160444934_0036_m_000002 successfully.
2013-10-31 16:20:55,179 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000003_0' has completed task_20131031160444934_0036_m_000003 successfully.
2013-10-31 16:20:55,315 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:55,319 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:20:55,320 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000000_0 is done.
2013-10-31 16:20:55,320 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000000_0 was -1
2013-10-31 16:20:55,320 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:20:55,764 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000004_0' has completed task_20131031160444934_0036_m_000004 successfully.
2013-10-31 16:20:58,161 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000000_0' has completed task_20131031160444934_0036_m_000000 successfully.
2013-10-31 16:20:58,163 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0036_m_000005_0' to tip task_20131031160444934_0036_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:20:58,166 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0036_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:20:58,166 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0036_m_000005_0 which needs 1 slots
2013-10-31 16:20:58,166 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0036_m_000005_0 which needs 1 slots
2013-10-31 16:20:58,197 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0036/attempt_20131031160444934_0036_m_000005_0. Attempting to reuse: jvm_20131031160444934_0036_m_-1374678209
2013-10-31 16:20:58,853 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0036_m_-1374678209 given task: attempt_20131031160444934_0036_m_000005_0
2013-10-31 16:20:58,949 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000005_0 0.0%
2013-10-31 16:20:59,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary dst=null perm=null
2013-10-31 16:20:59,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:20:59,191 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_SUCCESS from client DFSClient_attempt_20131031160444934_0036_m_000005_0
2013-10-31 16:20:59,191 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0036_m_000005_0
2013-10-31 16:20:59,200 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,200 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:59,201 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:59,201 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5817354174245219485 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,201 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,201 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:59,202 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:59,202 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3223268501587367091 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,202 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1039536471123630660 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,202 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1039536471123630660 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,202 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1039536471123630660 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:20:59,203 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8990161524735521721 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:20:59,203 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8990161524735521721 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:20:59,203 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8990161524735521721 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:20:59,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0036 dst=null perm=null
2013-10-31 16:21:00,373 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_3223268501587367091_1417 blk_1039536471123630660_1418 blk_-5817354174245219485_1416 blk_-8990161524735521721_1419
2013-10-31 16:21:00,373 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_3223268501587367091_1417 blk_1039536471123630660_1418 blk_-5817354174245219485_1416 blk_-8990161524735521721_1419
2013-10-31 16:21:01,165 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8990161524735521721_1419 file build/test/data/dfs/data/data6/current/blk_-8990161524735521721 for deletion
2013-10-31 16:21:01,165 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data5/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:01,165 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8990161524735521721_1419 at file build/test/data/dfs/data/data6/current/blk_-8990161524735521721
2013-10-31 16:21:01,167 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1039536471123630660_1418 file build/test/data/dfs/data/data5/current/blk_1039536471123630660 for deletion
2013-10-31 16:21:01,167 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data5/current/blk_-5817354174245219485
2013-10-31 16:21:01,168 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data6/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:01,168 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1039536471123630660_1418 at file build/test/data/dfs/data/data5/current/blk_1039536471123630660
2013-10-31 16:21:01,168 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data6/current/blk_3223268501587367091
2013-10-31 16:21:01,922 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0036_m_000005_0 0.0% cleanup
2013-10-31 16:21:01,923 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0036_m_000005_0 is done.
2013-10-31 16:21:01,923 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0036_m_000005_0 was -1
2013-10-31 16:21:01,923 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:02,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8990161524735521721_1419 file build/test/data/dfs/data/data2/current/blk_-8990161524735521721 for deletion
2013-10-31 16:21:02,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data1/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:02,949 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8990161524735521721_1419 at file build/test/data/dfs/data/data2/current/blk_-8990161524735521721
2013-10-31 16:21:02,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1039536471123630660_1418 file build/test/data/dfs/data/data1/current/blk_1039536471123630660 for deletion
2013-10-31 16:21:02,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data1/current/blk_-5817354174245219485
2013-10-31 16:21:02,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data2/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:02,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1039536471123630660_1418 at file build/test/data/dfs/data/data1/current/blk_1039536471123630660
2013-10-31 16:21:02,951 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data2/current/blk_3223268501587367091
2013-10-31 16:21:03,374 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_3223268501587367091_1417 blk_1039536471123630660_1418 blk_-5817354174245219485_1416
2013-10-31 16:21:03,374 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_3223268501587367091_1417 blk_-5817354174245219485_1416 blk_-8990161524735521721_1419
2013-10-31 16:21:03,549 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data4/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:03,549 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1039536471123630660_1418 file build/test/data/dfs/data/data4/current/blk_1039536471123630660 for deletion
2013-10-31 16:21:03,549 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data4/current/blk_-5817354174245219485
2013-10-31 16:21:03,549 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data3/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:03,550 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1039536471123630660_1418 at file build/test/data/dfs/data/data4/current/blk_1039536471123630660
2013-10-31 16:21:03,550 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data3/current/blk_3223268501587367091
2013-10-31 16:21:04,174 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0036_m_000005_0' has completed task_20131031160444934_0036_m_000005 successfully.
2013-10-31 16:21:04,175 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0036 has completed successfully.
2013-10-31 16:21:04,176 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0036,submitTime=1383236441121,launchTime=1383236442110,firstMapTaskLaunchTime=1383236449143,firstJobSetupTaskLaunchTime=1383236443125,firstJobCleanupTaskLaunchTime=1383236458163,finishTime=1383236464175,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E25DC1296648469AAAAE728C5F53A98B/BC1A1F8F3C3541DC8ADBFCA776760CA3] lhs/(1/1) ...edpipesplatform/samepipe3
2013-10-31 16:21:04,181 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC. blk_3626534413391577934_1428
2013-10-31 16:21:04,183 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3626534413391577934_1428 src: /127.0.0.1:56942 dest: /127.0.0.1:41648
2013-10-31 16:21:05,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3626534413391577934_1428 src: /127.0.0.1:36838 dest: /127.0.0.1:50942
2013-10-31 16:21:05,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3626534413391577934_1428 src: /127.0.0.1:36908 dest: /127.0.0.1:38271
2013-10-31 16:21:05,260 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36908, dest: /127.0.0.1:38271, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3626534413391577934_1428, duration: 5363722
2013-10-31 16:21:05,261 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3626534413391577934_1428 terminating
2013-10-31 16:21:05,261 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36838, dest: /127.0.0.1:50942, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3626534413391577934_1428, duration: 4884294
2013-10-31 16:21:05,262 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3626534413391577934_1428 terminating
2013-10-31 16:21:05,262 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56942, dest: /127.0.0.1:41648, bytes: 26329, op: HDFS_WRITE, cliID: DFSClient_-1735618845, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3626534413391577934_1428, duration: 7237958
2013-10-31 16:21:05,263 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3626534413391577934_1428 terminating
2013-10-31 16:21:05,267 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3626534413391577934_1428 size 26329
2013-10-31 16:21:05,267 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC from client DFSClient_-1735618845
2013-10-31 16:21:05,268 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_logs/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC is closed by DFSClient_-1735618845
2013-10-31 16:21:05,268 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2286 Total time for transactions(ms): 49Number of transactions batched in Syncs: 256 Number of syncs: 1639 SyncTimes(ms): 78307 16103
2013-10-31 16:21:05,268 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3626534413391577934_1428 size 26329
2013-10-31 16:21:05,269 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3626534413391577934_1428 size 26329
2013-10-31 16:21:05,482 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0036_1383236441121_hadoop_%5BE25DC1296648469AAAAE728C5F53A98B%2FBC1A1F8F3C3541DC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:05,485 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000000_0'
2013-10-31 16:21:05,486 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000001_0'
2013-10-31 16:21:05,486 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000005_0'
2013-10-31 16:21:05,487 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8553465570091622260 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:05,487 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000006_0'
2013-10-31 16:21:05,488 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8553465570091622260 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:05,488 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0036_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:05,488 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8553465570091622260 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:05,488 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000004_0'
2013-10-31 16:21:05,490 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000002_0'
2013-10-31 16:21:05,490 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:05,490 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0036_m_000003_0'
2013-10-31 16:21:05,490 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0036 being deleted.
2013-10-31 16:21:05,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0036 dst=null perm=null
2013-10-31 16:21:05,497 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/_temporary
2013-10-31 16:21:05,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=null
2013-10-31 16:21:05,517 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:21:05,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null
2013-10-31 16:21:05,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001 dst=null perm=null
2013-10-31 16:21:05,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002 dst=null perm=null
2013-10-31 16:21:05,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003 dst=null perm=null
2013-10-31 16:21:05,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004 dst=null perm=null
2013-10-31 16:21:05,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null
2013-10-31 16:21:05,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36841, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1303671696596010570_1423, duration: 347250
2013-10-31 16:21:05,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001 dst=null perm=null
2013-10-31 16:21:05,530 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56947, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8735242422086387614_1424, duration: 257113
2013-10-31 16:21:05,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002 dst=null perm=null
2013-10-31 16:21:05,533 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56948, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3563163408596565662_1426, duration: 291853
2013-10-31 16:21:05,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003 dst=null perm=null
2013-10-31 16:21:05,536 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49946, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6798991363969057773_1426, duration: 252081
2013-10-31 16:21:05,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004 dst=null perm=null
2013-10-31 16:21:05,539 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49947, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-115642158726394487_1427, duration: 248103
2013-10-31 16:21:05,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=null
2013-10-31 16:21:05,557 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:21:05,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null
2013-10-31 16:21:05,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001 dst=null perm=null
2013-10-31 16:21:05,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002 dst=null perm=null
2013-10-31 16:21:05,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003 dst=null perm=null
2013-10-31 16:21:05,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004 dst=null perm=null
2013-10-31 16:21:05,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null
2013-10-31 16:21:05,566 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49948, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1303671696596010570_1423, duration: 269850
2013-10-31 16:21:05,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001 dst=null perm=null
2013-10-31 16:21:05,569 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56952, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8735242422086387614_1424, duration: 256256
2013-10-31 16:21:05,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002 dst=null perm=null
2013-10-31 16:21:05,572 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36917, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3563163408596565662_1426, duration: 256740
2013-10-31 16:21:05,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003 dst=null perm=null
2013-10-31 16:21:05,575 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56954, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6798991363969057773_1426, duration: 250081
2013-10-31 16:21:05,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004 dst=null perm=null
2013-10-31 16:21:05,578 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36919, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-115642158726394487_1427, duration: 250943
2013-10-31 16:21:05,578 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipe3
2013-10-31 16:21:05,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3 dst=null perm=null
2013-10-31 16:21:05,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00000 dst=null perm=null
2013-10-31 16:21:05,587 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56956, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1303671696596010570_1423, duration: 347935
2013-10-31 16:21:05,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00001 dst=null perm=null
2013-10-31 16:21:05,591 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36852, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8735242422086387614_1424, duration: 256710
2013-10-31 16:21:05,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00002 dst=null perm=null
2013-10-31 16:21:05,595 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36922, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3563163408596565662_1426, duration: 245498
2013-10-31 16:21:05,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00003 dst=null perm=null
2013-10-31 16:21:05,599 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56959, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6798991363969057773_1426, duration: 244063
2013-10-31 16:21:05,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe3/part-00004 dst=null perm=null
2013-10-31 16:21:05,603 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36924, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-115642158726394487_1427, duration: 244750
2013-10-31 16:21:05,623 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:21:05,624 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:21:05,638 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:21:05,638 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:21:05,639 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:21:05,639 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby"]
2013-10-31 16:21:05,639 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:21:05,639 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:21:05,640 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:21:05,640 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...pipesplatform/joingroupby
2013-10-31 16:21:05,643 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:21:05,643 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 16:21:05,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:05,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:21:05,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,669 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar. blk_-6908714528030553586_1429
2013-10-31 16:21:05,671 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:49958 dest: /127.0.0.1:47311
2013-10-31 16:21:05,672 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:56962 dest: /127.0.0.1:41648
2013-10-31 16:21:05,674 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:36927 dest: /127.0.0.1:38271
2013-10-31 16:21:05,682 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36927, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6908714528030553586_1429, duration: 4155304
2013-10-31 16:21:05,682 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6908714528030553586_1429 terminating
2013-10-31 16:21:05,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56962, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-6908714528030553586_1429, duration: 5465303
2013-10-31 16:21:05,683 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6908714528030553586_1429 terminating
2013-10-31 16:21:05,684 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49958, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-6908714528030553586_1429, duration: 5992070
2013-10-31 16:21:05,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6908714528030553586_1429 terminating
2013-10-31 16:21:05,686 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:05,686 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar from client DFSClient_1457307213
2013-10-31 16:21:05,687 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar is closed by DFSClient_1457307213
2013-10-31 16:21:05,688 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:05,688 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:05,695 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar. New replication is 10
2013-10-31 16:21:05,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar dst=null perm=null
2013-10-31 16:21:05,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,710 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:21:05,712 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:05,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:05,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,731 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split. New replication is 10
2013-10-31 16:21:05,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=null
2013-10-31 16:21:05,740 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split. blk_-2094827360920713963_1430
2013-10-31 16:21:05,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:49961 dest: /127.0.0.1:47311
2013-10-31 16:21:05,743 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:36929 dest: /127.0.0.1:38271
2013-10-31 16:21:05,744 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:56966 dest: /127.0.0.1:41648
2013-10-31 16:21:05,746 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2094827360920713963_1430 src: /127.0.0.1:36862 dest: /127.0.0.1:50942
2013-10-31 16:21:05,749 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36862, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2094827360920713963_1430, duration: 1655787
2013-10-31 16:21:05,750 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,750 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56966, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 1073454
2013-10-31 16:21:05,751 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,751 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,751 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36929, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2094827360920713963_1430, duration: 1954010
2013-10-31 16:21:05,751 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,752 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49961, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2094827360920713963_1430, duration: 2795667
2013-10-31 16:21:05,752 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,752 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2094827360920713963_1430 terminating
2013-10-31 16:21:05,755 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,755 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2094827360920713963_1430 size 1732
2013-10-31 16:21:05,756 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split from client DFSClient_1457307213
2013-10-31 16:21:05,756 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split is closed by DFSClient_1457307213
2013-10-31 16:21:05,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,779 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo. blk_1425349623274254743_1431
2013-10-31 16:21:05,780 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1425349623274254743_1431 src: /127.0.0.1:56968 dest: /127.0.0.1:41648
2013-10-31 16:21:05,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1425349623274254743_1431 src: /127.0.0.1:36864 dest: /127.0.0.1:50942
2013-10-31 16:21:05,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1425349623274254743_1431 src: /127.0.0.1:49967 dest: /127.0.0.1:47311
2013-10-31 16:21:05,786 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49967, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1425349623274254743_1431, duration: 64252
2013-10-31 16:21:05,787 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1425349623274254743_1431 terminating
2013-10-31 16:21:05,787 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1425349623274254743_1431 size 183
2013-10-31 16:21:05,787 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36864, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1425349623274254743_1431, duration: 923015
2013-10-31 16:21:05,788 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1425349623274254743_1431 terminating
2013-10-31 16:21:05,788 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56968, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1425349623274254743_1431, duration: 1781479
2013-10-31 16:21:05,789 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1425349623274254743_1431 size 183
2013-10-31 16:21:05,789 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1425349623274254743_1431 terminating
2013-10-31 16:21:05,791 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:21:05,791 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:21:05,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1425349623274254743_1431 size 183
2013-10-31 16:21:05,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:05,821 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml. blk_2882572055122643041_1432
2013-10-31 16:21:05,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2882572055122643041_1432 src: /127.0.0.1:49968 dest: /127.0.0.1:47311
2013-10-31 16:21:05,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2882572055122643041_1432 src: /127.0.0.1:36867 dest: /127.0.0.1:50942
2013-10-31 16:21:05,826 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2882572055122643041_1432 src: /127.0.0.1:56973 dest: /127.0.0.1:41648
2013-10-31 16:21:05,829 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56973, dest: /127.0.0.1:41648, bytes: 28654, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2882572055122643041_1432, duration: 165018
2013-10-31 16:21:05,829 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2882572055122643041_1432 terminating
2013-10-31 16:21:05,830 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36867, dest: /127.0.0.1:50942, bytes: 28654, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2882572055122643041_1432, duration: 954399
2013-10-31 16:21:05,830 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2882572055122643041_1432 terminating
2013-10-31 16:21:05,830 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2882572055122643041_1432 size 28654
2013-10-31 16:21:05,831 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49968, dest: /127.0.0.1:47311, bytes: 28654, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2882572055122643041_1432, duration: 1740240
2013-10-31 16:21:05,831 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2882572055122643041_1432 size 28654
2013-10-31 16:21:05,831 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2882572055122643041_1432 terminating
2013-10-31 16:21:05,834 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2882572055122643041_1432 size 28654
2013-10-31 16:21:05,835 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml from client DFSClient_1457307213
2013-10-31 16:21:05,835 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml is closed by DFSClient_1457307213
2013-10-31 16:21:06,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8990161524735521721_1419 file build/test/data/dfs/data/data7/current/blk_-8990161524735521721 for deletion
2013-10-31 16:21:06,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5817354174245219485_1416 file build/test/data/dfs/data/data7/current/blk_-5817354174245219485 for deletion
2013-10-31 16:21:06,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8990161524735521721_1419 at file build/test/data/dfs/data/data7/current/blk_-8990161524735521721
2013-10-31 16:21:06,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3223268501587367091_1417 file build/test/data/dfs/data/data8/current/blk_3223268501587367091 for deletion
2013-10-31 16:21:06,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5817354174245219485_1416 at file build/test/data/dfs/data/data7/current/blk_-5817354174245219485
2013-10-31 16:21:06,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3223268501587367091_1417 at file build/test/data/dfs/data/data8/current/blk_3223268501587367091
2013-10-31 16:21:06,375 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:47311 to replicate blk_-6908714528030553586_1429 to datanode(s) 127.0.0.1:50942
2013-10-31 16:21:06,376 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-8553465570091622260_1422
2013-10-31 16:21:06,376 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-8553465570091622260_1422
2013-10-31 16:21:06,550 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837) Starting thread to transfer block blk_-6908714528030553586_1429 to 127.0.0.1:50942
2013-10-31 16:21:06,550 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8553465570091622260_1422 file build/test/data/dfs/data/data3/current/blk_-8553465570091622260 for deletion
2013-10-31 16:21:06,551 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8553465570091622260_1422 at file build/test/data/dfs/data/data3/current/blk_-8553465570091622260
2013-10-31 16:21:06,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6908714528030553586_1429 src: /127.0.0.1:36869 dest: /127.0.0.1:50942
2013-10-31 16:21:06,552 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:47311, storageID=DS-1772526979-10.5.128.102-47311-1383235482154, infoPort=48798, ipcPort=34837):Transmitted block blk_-6908714528030553586_1429 to /127.0.0.1:50942
2013-10-31 16:21:06,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-6908714528030553586_1429 src: /127.0.0.1:36869 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:21:06,556 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-6908714528030553586_1429 size 238055
2013-10-31 16:21:06,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml dst=null perm=null
2013-10-31 16:21:06,967 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56976, bytes: 28878, op: HDFS_READ, cliID: DFSClient_385456919, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2882572055122643041_1432, duration: 381929
2013-10-31 16:21:06,986 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0037: nMaps=5 nReduces=1 max=-1
2013-10-31 16:21:06,987 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0037 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:21:06,987 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0037
2013-10-31 16:21:06,987 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0037
2013-10-31 16:21:06,987 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0037 RESULT=SUCCESS
2013-10-31 16:21:06,988 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0037
2013-10-31 16:21:06,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:07,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:07,015 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml. blk_-2516906943335505181_1434
2013-10-31 16:21:07,017 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2516906943335505181_1434 src: /127.0.0.1:49974 dest: /127.0.0.1:47311
2013-10-31 16:21:07,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2516906943335505181_1434 src: /127.0.0.1:36873 dest: /127.0.0.1:50942
2013-10-31 16:21:07,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2516906943335505181_1434 src: /127.0.0.1:36943 dest: /127.0.0.1:38271
2013-10-31 16:21:07,024 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36943, dest: /127.0.0.1:38271, bytes: 28719, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2516906943335505181_1434, duration: 491978
2013-10-31 16:21:07,025 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2516906943335505181_1434 terminating
2013-10-31 16:21:07,025 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36873, dest: /127.0.0.1:50942, bytes: 28719, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2516906943335505181_1434, duration: 1271095
2013-10-31 16:21:07,026 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2516906943335505181_1434 terminating
2013-10-31 16:21:07,026 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-2516906943335505181_1434 size 28719
2013-10-31 16:21:07,026 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49974, dest: /127.0.0.1:47311, bytes: 28719, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-2516906943335505181_1434, duration: 2180225
2013-10-31 16:21:07,027 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2516906943335505181_1434 terminating
2013-10-31 16:21:07,029 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml from client DFSClient_385456919
2013-10-31 16:21:07,029 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_conf.xml is closed by DFSClient_385456919
2013-10-31 16:21:07,029 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-2516906943335505181_1434 size 28719
2013-10-31 16:21:07,031 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-2516906943335505181_1434 size 28719
2013-10-31 16:21:07,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:07,049 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken. blk_-5455871274990294667_1435
2013-10-31 16:21:07,051 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5455871274990294667_1435 src: /127.0.0.1:56980 dest: /127.0.0.1:41648
2013-10-31 16:21:07,053 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5455871274990294667_1435 src: /127.0.0.1:36876 dest: /127.0.0.1:50942
2013-10-31 16:21:07,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5455871274990294667_1435 src: /127.0.0.1:36946 dest: /127.0.0.1:38271
2013-10-31 16:21:07,059 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36946, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-5455871274990294667_1435, duration: 65721
2013-10-31 16:21:07,059 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5455871274990294667_1435 terminating
2013-10-31 16:21:07,060 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36876, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5455871274990294667_1435, duration: 2896803
2013-10-31 16:21:07,060 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5455871274990294667_1435 terminating
2013-10-31 16:21:07,061 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:56980, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5455871274990294667_1435, duration: 3771298
2013-10-31 16:21:07,061 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5455871274990294667_1435 terminating
2013-10-31 16:21:07,061 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-5455871274990294667_1435 size 116
2013-10-31 16:21:07,063 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken from client DFSClient_1457307213
2013-10-31 16:21:07,063 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken is closed by DFSClient_1457307213
2013-10-31 16:21:07,064 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-5455871274990294667_1435 size 116
2013-10-31 16:21:07,064 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-5455871274990294667_1435 size 116
2013-10-31 16:21:07,071 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken
2013-10-31 16:21:07,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.splitmetainfo dst=null perm=null
2013-10-31 16:21:07,075 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49980, bytes: 187, op: HDFS_READ, cliID: DFSClient_385456919, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1425349623274254743_1431, duration: 257712
2013-10-31 16:21:07,077 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0037 = 19. Number of splits = 5
2013-10-31 16:21:07,077 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,077 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,078 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,079 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,080 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0037_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:07,081 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0037 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:21:07,081 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0037 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 16:21:07,166 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8553465570091622260_1422 file build/test/data/dfs/data/data6/current/blk_-8553465570091622260 for deletion
2013-10-31 16:21:07,167 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8553465570091622260_1422 at file build/test/data/dfs/data/data6/current/blk_-8553465570091622260
2013-10-31 16:21:08,493 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0037_m_000006_0' to tip task_20131031160444934_0037_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:08,501 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:21:08,501 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000006_0 which needs 1 slots
2013-10-31 16:21:08,502 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000006_0 which needs 1 slots
2013-10-31 16:21:08,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken dst=null perm=null
2013-10-31 16:21:08,510 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56984, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5455871274990294667_1435, duration: 297502
2013-10-31 16:21:08,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml dst=null perm=null
2013-10-31 16:21:08,524 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:49983, bytes: 28878, op: HDFS_READ, cliID: DFSClient_-73383415, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2882572055122643041_1432, duration: 373121
2013-10-31 16:21:08,554 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:08,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar dst=null perm=null
2013-10-31 16:21:08,582 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36882, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-73383415, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6908714528030553586_1429, duration: 1180756
2013-10-31 16:21:08,689 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0036_m_-1410338411
2013-10-31 16:21:08,698 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group428 with signal TERM. Exit code 0
2013-10-31 16:21:08,698 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:08,699 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_-719453515 spawned.
2013-10-31 16:21:08,702 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000006_0/taskjvm.sh
2013-10-31 16:21:09,113 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0036_m_-1410338411
2013-10-31 16:21:09,377 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-8553465570091622260_1422
2013-10-31 16:21:09,463 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:09,463 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:09,463 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:09,463 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_-1410338411 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:10,119 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_-719453515 given task: attempt_20131031160444934_0037_m_000006_0
2013-10-31 16:21:10,489 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:10,489 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000000_0 not found in cache
2013-10-31 16:21:10,489 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000001_0 not found in cache
2013-10-31 16:21:10,489 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000005_0 not found in cache
2013-10-31 16:21:10,489 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0036 for user-log deletion with retainTimeStamp:1383322870489
2013-10-31 16:21:10,489 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:10,490 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000004_0 not found in cache
2013-10-31 16:21:10,490 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0036 for user-log deletion with retainTimeStamp:1383322870490
2013-10-31 16:21:10,491 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0036
2013-10-31 16:21:10,491 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000003_0 not found in cache
2013-10-31 16:21:10,491 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0036_m_000002_0 not found in cache
2013-10-31 16:21:10,491 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0036 for user-log deletion with retainTimeStamp:1383322870491
2013-10-31 16:21:10,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:11,022 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_764575079 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,030 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group496 with signal TERM. Exit code 0
2013-10-31 16:21:11,031 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_986697684 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,038 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group499 with signal TERM. Exit code 0
2013-10-31 16:21:11,217 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,217 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,217 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:11,218 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_764575079 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:11,218 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,218 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,218 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:11,219 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_986697684 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:11,461 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_-1374678209 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,470 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32726 with signal TERM. Exit code 0
2013-10-31 16:21:11,644 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,644 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,644 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:11,645 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_-1374678209 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 16:21:11,737 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0036_m_-2008477174 since job job_20131031160444934_0036 is dead
2013-10-31 16:21:11,747 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group590 with signal TERM. Exit code 0
2013-10-31 16:21:11,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8553465570091622260_1422 file build/test/data/dfs/data/data2/current/blk_-8553465570091622260 for deletion
2013-10-31 16:21:11,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8553465570091622260_1422 at file build/test/data/dfs/data/data2/current/blk_-8553465570091622260
2013-10-31 16:21:11,961 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:11,961 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:11,961 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:11,961 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0036_m_-2008477174 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:13,538 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000006_0 0.0% setup
2013-10-31 16:21:13,540 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000006_0 is done.
2013-10-31 16:21:13,541 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000006_0 was -1
2013-10-31 16:21:13,541 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:14,508 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000006_0' has completed task_20131031160444934_0037_m_000006 successfully.
2013-10-31 16:21:14,649 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000000_0' to tip task_20131031160444934_0037_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:14,651 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000000
2013-10-31 16:21:14,651 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000001_0' to tip task_20131031160444934_0037_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:14,652 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000001
2013-10-31 16:21:14,653 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000002_0' to tip task_20131031160444934_0037_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:14,653 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000002
2013-10-31 16:21:14,654 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:21:14,654 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000003_0' to tip task_20131031160444934_0037_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:14,655 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:21:14,655 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000000_0 which needs 1 slots
2013-10-31 16:21:14,655 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000003
2013-10-31 16:21:14,655 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000000_0 which needs 1 slots
2013-10-31 16:21:14,656 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000001_0 which needs 1 slots
2013-10-31 16:21:14,656 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0037_m_000001_0 which needs 1 slots
2013-10-31 16:21:14,656 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0037_m_000004_0' to tip task_20131031160444934_0037_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:21:14,657 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0037_m_000004
2013-10-31 16:21:14,692 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:21:14,692 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:21:14,693 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:21:14,693 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000004_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000002_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000004_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000002_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000003_0 which needs 1 slots
2013-10-31 16:21:14,694 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0037_m_000003_0 which needs 1 slots
2013-10-31 16:21:14,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken dst=null perm=null
2013-10-31 16:21:14,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037/jobToken dst=null perm=null
2013-10-31 16:21:14,795 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_170743000
2013-10-31 16:21:14,796 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_170743000 spawned.
2013-10-31 16:21:14,798 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0037/attempt_20131031160444934_0037_m_000001_0. Attempting to reuse: jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:14,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36885, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5455871274990294667_1435, duration: 2464547
2013-10-31 16:21:14,800 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56991, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5455871274990294667_1435, duration: 382159
2013-10-31 16:21:14,801 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000000_0/taskjvm.sh
2013-10-31 16:21:14,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml dst=null perm=null
2013-10-31 16:21:14,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.xml dst=null perm=null
2013-10-31 16:21:14,811 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36889, bytes: 28878, op: HDFS_READ, cliID: DFSClient_-2062392550, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2882572055122643041_1432, duration: 399151
2013-10-31 16:21:14,812 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36890, bytes: 28878, op: HDFS_READ, cliID: DFSClient_-1210340384, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2882572055122643041_1432, duration: 397216
2013-10-31 16:21:14,835 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:14,835 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:14,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar dst=null perm=null
2013-10-31 16:21:14,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.jar dst=null perm=null
2013-10-31 16:21:14,861 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36960, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2062392550, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-6908714528030553586_1429, duration: 853533
2013-10-31 16:21:14,864 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36892, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1210340384, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-6908714528030553586_1429, duration: 1664090
2013-10-31 16:21:14,918 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_2019793849
2013-10-31 16:21:14,919 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_2019793849 spawned.
2013-10-31 16:21:14,919 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_-2116369040
2013-10-31 16:21:14,921 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_-2116369040 spawned.
2013-10-31 16:21:14,921 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000003_0/taskjvm.sh
2013-10-31 16:21:14,922 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000002_0/taskjvm.sh
2013-10-31 16:21:14,934 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_m_1747797240
2013-10-31 16:21:14,935 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_m_1747797240 spawned.
2013-10-31 16:21:14,936 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_m_000004_0/taskjvm.sh
2013-10-31 16:21:15,100 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_-719453515 given task: attempt_20131031160444934_0037_m_000001_0
2013-10-31 16:21:15,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=null
2013-10-31 16:21:15,220 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:56999, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 171615
2013-10-31 16:21:15,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:15,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36964, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 113723
2013-10-31 16:21:15,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:15,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:15,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36897, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 131561
2013-10-31 16:21:15,719 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_170743000 given task: attempt_20131031160444934_0037_m_000000_0
2013-10-31 16:21:16,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=null
2013-10-31 16:21:16,216 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57004, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 168798
2013-10-31 16:21:16,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:16,521 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_2019793849 given task: attempt_20131031160444934_0037_m_000003_0
2013-10-31 16:21:16,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:16,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:16,532 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57008, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 128559
2013-10-31 16:21:16,535 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50006, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 99441
2013-10-31 16:21:16,550 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_1747797240 given task: attempt_20131031160444934_0037_m_000004_0
2013-10-31 16:21:16,550 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_-2116369040 given task: attempt_20131031160444934_0037_m_000002_0
2013-10-31 16:21:17,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=null
2013-10-31 16:21:17,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=null
2013-10-31 16:21:17,045 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36908, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-2094827360920713963_1430, duration: 245849
2013-10-31 16:21:17,047 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:36978, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000003_0, offset: 1024, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-2094827360920713963_1430, duration: 143073
2013-10-31 16:21:17,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037/job.split dst=null perm=null
2013-10-31 16:21:17,061 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57015, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000004_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-2094827360920713963_1430, duration: 143428
2013-10-31 16:21:17,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:17,084 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50013, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 104609
2013-10-31 16:21:17,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:17,087 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36912, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 158969
2013-10-31 16:21:17,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:17,102 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50015, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 146765
2013-10-31 16:21:17,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:17,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:17,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:17,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:17,364 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36914, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 1309250
2013-10-31 16:21:17,365 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50017, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 152386
2013-10-31 16:21:17,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:17,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:21:17,379 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36916, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0037_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 107711
2013-10-31 16:21:18,169 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:21:18,171 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000001_0 is done.
2013-10-31 16:21:18,172 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000001_0 was 35
2013-10-31 16:21:18,172 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:19,145 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:21:19,148 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000000_0 is done.
2013-10-31 16:21:19,148 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000000_0 was 35
2013-10-31 16:21:19,149 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:19,655 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0037_m_000006_0
2013-10-31 16:21:19,656 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0037_m_000006_0
2013-10-31 16:21:19,656 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0037_m_000006_0 not found in cache
2013-10-31 16:21:19,970 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:21:19,973 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:21:19,974 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000003_0 is done.
2013-10-31 16:21:19,974 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000003_0 was 35
2013-10-31 16:21:19,974 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:19,975 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000002_0 is done.
2013-10-31 16:21:19,975 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000002_0 was 35
2013-10-31 16:21:19,976 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:19,988 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:21:19,990 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000004_0 is done.
2013-10-31 16:21:19,990 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000004_0 was 35
2013-10-31 16:21:19,990 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:20,660 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000000_0' has completed task_20131031160444934_0037_m_000000 successfully.
2013-10-31 16:21:20,662 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000001_0' has completed task_20131031160444934_0037_m_000001 successfully.
2013-10-31 16:21:20,664 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031160444934_0037_r_000000_0' to tip task_20131031160444934_0037_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:20,666 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_r_000000_0 task's state:UNASSIGNED
2013-10-31 16:21:20,667 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_r_000000_0 which needs 1 slots
2013-10-31 16:21:20,667 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_r_000000_0 which needs 1 slots
2013-10-31 16:21:20,695 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0037_r_206848199
2013-10-31 16:21:20,696 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0037_r_206848199 spawned.
2013-10-31 16:21:20,697 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000002_0' has completed task_20131031160444934_0037_m_000002 successfully.
2013-10-31 16:21:20,698 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0037/attempt_20131031160444934_0037_r_000000_0/taskjvm.sh
2013-10-31 16:21:20,943 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000003_0' has completed task_20131031160444934_0037_m_000003 successfully.
2013-10-31 16:21:20,944 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000004_0' has completed task_20131031160444934_0037_m_000004 successfully.
2013-10-31 16:21:21,761 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_r_206848199 given task: attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:27,465 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60644, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000000_0, duration: 9239217
2013-10-31 16:21:27,489 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:49137, dest: 10.5.128.102:60644, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000001_0, duration: 10631582
2013-10-31 16:21:27,506 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:49520, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000002_0, duration: 12642289
2013-10-31 16:21:27,522 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:38122, dest: 10.5.128.102:49520, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000003_0, duration: 11521265
2013-10-31 16:21:27,539 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:42911, dest: 10.5.128.102:48714, bytes: 35, op: MAPRED_SHUFFLE, cliID: attempt_20131031160444934_0037_m_000004_0, duration: 12371906
2013-10-31 16:21:28,259 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:28,319 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:28,380 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:28,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:28,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:28,614 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000. blk_-4902470675330313153_1436
2013-10-31 16:21:28,639 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4902470675330313153_1436 src: /127.0.0.1:50024 dest: /127.0.0.1:47311
2013-10-31 16:21:28,640 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4902470675330313153_1436 src: /127.0.0.1:57028 dest: /127.0.0.1:41648
2013-10-31 16:21:28,641 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4902470675330313153_1436 src: /127.0.0.1:36993 dest: /127.0.0.1:38271
2013-10-31 16:21:28,645 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36993, dest: /127.0.0.1:38271, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0037_r_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4902470675330313153_1436, duration: 1397776
2013-10-31 16:21:28,645 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4902470675330313153_1436 terminating
2013-10-31 16:21:28,648 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-4902470675330313153_1436 size 40
2013-10-31 16:21:28,649 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57028, dest: /127.0.0.1:41648, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0037_r_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4902470675330313153_1436, duration: 2839670
2013-10-31 16:21:28,650 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4902470675330313153_1436 size 40
2013-10-31 16:21:28,650 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4902470675330313153_1436 terminating
2013-10-31 16:21:28,650 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50024, dest: /127.0.0.1:47311, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0037_r_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4902470675330313153_1436, duration: 7481263
2013-10-31 16:21:28,650 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4902470675330313153_1436 terminating
2013-10-31 16:21:28,652 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:28,653 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:28,654 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4902470675330313153_1436 size 40
2013-10-31 16:21:28,694 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0037_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:28,694 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 16:21:29,675 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031160444934_0037_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:43831
2013-10-31 16:21:29,676 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:29,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0 dst=null perm=null
2013-10-31 16:21:29,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:29,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:29,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary/_attempt_20131031160444934_0037_r_000000_0 dst=null perm=null
2013-10-31 16:21:31,308 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 1.0% reduce > reduce
2013-10-31 16:21:31,310 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_r_000000_0 1.0% reduce > reduce
2013-10-31 16:21:31,311 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_r_000000_0 is done.
2013-10-31 16:21:31,311 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_r_000000_0 was -1
2013-10-31 16:21:31,311 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:32,680 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_r_000000_0' has completed task_20131031160444934_0037_r_000000 successfully.
2013-10-31 16:21:32,683 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0037_m_000005_0' to tip task_20131031160444934_0037_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:32,685 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0037_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:21:32,685 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0037_m_000005_0 which needs 1 slots
2013-10-31 16:21:32,686 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0037_m_000005_0 which needs 1 slots
2013-10-31 16:21:32,800 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0037/attempt_20131031160444934_0037_m_000005_0. Attempting to reuse: jvm_20131031160444934_0037_m_170743000
2013-10-31 16:21:33,217 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0037_m_170743000 given task: attempt_20131031160444934_0037_m_000005_0
2013-10-31 16:21:33,350 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000005_0 0.0%
2013-10-31 16:21:33,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary dst=null perm=null
2013-10-31 16:21:33,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:33,375 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_SUCCESS from client DFSClient_attempt_20131031160444934_0037_m_000005_0
2013-10-31 16:21:33,376 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0037_m_000005_0
2013-10-31 16:21:33,553 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:33,553 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,554 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,554 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6908714528030553586 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,554 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,554 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,555 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,555 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2094827360920713963 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:33,555 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1425349623274254743 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,555 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1425349623274254743 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,555 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1425349623274254743 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,556 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2882572055122643041 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:33,556 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2882572055122643041 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:33,556 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2882572055122643041 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:33,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0037 dst=null perm=null
2013-10-31 16:21:36,324 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0037_m_000005_0 0.0% cleanup
2013-10-31 16:21:36,325 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0037_m_000005_0 is done.
2013-10-31 16:21:36,326 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0037_m_000005_0 was -1
2013-10-31 16:21:36,326 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:36,381 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-6908714528030553586_1429 blk_-2094827360920713963_1430
2013-10-31 16:21:36,381 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_1425349623274254743_1431 blk_-6908714528030553586_1429 blk_2882572055122643041_1432 blk_-2094827360920713963_1430
2013-10-31 16:21:36,560 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data3/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:36,560 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data4/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:36,560 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data3/current/blk_-6908714528030553586
2013-10-31 16:21:36,560 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data4/current/blk_-2094827360920713963
2013-10-31 16:21:36,560 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1425349623274254743_1431 file build/test/data/dfs/data/data3/current/blk_1425349623274254743 for deletion
2013-10-31 16:21:36,561 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2882572055122643041_1432 file build/test/data/dfs/data/data4/current/blk_2882572055122643041 for deletion
2013-10-31 16:21:36,561 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1425349623274254743_1431 at file build/test/data/dfs/data/data3/current/blk_1425349623274254743
2013-10-31 16:21:36,562 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2882572055122643041_1432 at file build/test/data/dfs/data/data4/current/blk_2882572055122643041
2013-10-31 16:21:37,686 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:37,686 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0037_r_000000_0
2013-10-31 16:21:38,693 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0037_m_000005_0' has completed task_20131031160444934_0037_m_000005 successfully.
2013-10-31 16:21:38,961 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data1/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:38,961 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data2/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:39,381 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_1425349623274254743_1431 blk_-6908714528030553586_1429 blk_2882572055122643041_1432 blk_-2094827360920713963_1430
2013-10-31 16:21:39,382 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_1425349623274254743_1431 blk_-6908714528030553586_1429 blk_2882572055122643041_1432 blk_-2094827360920713963_1430
2013-10-31 16:21:39,847 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:21:39,862 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,871 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,876 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,882 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,887 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,892 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:21:39,893 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 16:21:39,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data2/current/blk_-2094827360920713963
2013-10-31 16:21:39,950 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data1/current/blk_-6908714528030553586
2013-10-31 16:21:39,951 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0037 has completed successfully.
2013-10-31 16:21:39,951 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0037,submitTime=1383236466958,launchTime=1383236467081,firstMapTaskLaunchTime=1383236474649,firstReduceTaskLaunchTime=1383236480663,firstJobSetupTaskLaunchTime=1383236468493,firstJobCleanupTaskLaunchTime=1383236492682,finishTime=1383236499951,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[6276220B6D5C41E99CB784247E017C0C/AF7CF26E39CB4FABBFCD63E64566EF85] lower*upper/(1/1) ...pipesplatform/joingroupby
2013-10-31 16:21:39,958 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB. blk_8631568984076934450_1437
2013-10-31 16:21:39,960 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8631568984076934450_1437 src: /127.0.0.1:37000 dest: /127.0.0.1:38271
2013-10-31 16:21:39,962 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8631568984076934450_1437 src: /127.0.0.1:36932 dest: /127.0.0.1:50942
2013-10-31 16:21:39,964 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8631568984076934450_1437 src: /127.0.0.1:50035 dest: /127.0.0.1:47311
2013-10-31 16:21:39,994 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50035, dest: /127.0.0.1:47311, bytes: 31995, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8631568984076934450_1437, duration: 4006042
2013-10-31 16:21:39,994 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8631568984076934450_1437 terminating
2013-10-31 16:21:39,994 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36932, dest: /127.0.0.1:50942, bytes: 31995, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8631568984076934450_1437, duration: 27913777
2013-10-31 16:21:39,995 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8631568984076934450_1437 terminating
2013-10-31 16:21:39,995 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8631568984076934450_1437 size 31995
2013-10-31 16:21:39,995 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37000, dest: /127.0.0.1:38271, bytes: 31995, op: HDFS_WRITE, cliID: DFSClient_385456919, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8631568984076934450_1437, duration: 28858762
2013-10-31 16:21:39,996 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8631568984076934450_1437 terminating
2013-10-31 16:21:39,998 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8631568984076934450_1437 size 31995
2013-10-31 16:21:39,999 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB from client DFSClient_385456919
2013-10-31 16:21:39,999 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_logs/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB is closed by DFSClient_385456919
2013-10-31 16:21:40,000 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8631568984076934450_1437 size 31995
2013-10-31 16:21:40,007 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0037_1383236466958_hadoop_%5B6276220B6D5C41E99CB784247E017C0C%2FAF7CF26E39CB4FAB to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:40,008 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000000_0'
2013-10-31 16:21:40,008 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000001_0'
2013-10-31 16:21:40,008 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000005_0'
2013-10-31 16:21:40,009 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000006_0'
2013-10-31 16:21:40,010 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_r_000000_0'
2013-10-31 16:21:40,010 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5455871274990294667 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:40,010 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5455871274990294667 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:40,010 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5455871274990294667 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:40,011 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000004_0'
2013-10-31 16:21:40,011 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000002_0'
2013-10-31 16:21:40,012 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0037_m_000003_0'
2013-10-31 16:21:40,013 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0037_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:21:40,022 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/_temporary
2013-10-31 16:21:40,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0037 dst=null perm=null
2013-10-31 16:21:40,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby dst=null perm=null
2013-10-31 16:21:40,080 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:40,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000 dst=null perm=null
2013-10-31 16:21:40,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000 dst=null perm=null
2013-10-31 16:21:40,085 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50037, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4902470675330313153_1436, duration: 278697
2013-10-31 16:21:40,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby dst=null perm=null
2013-10-31 16:21:40,103 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:40,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000 dst=null perm=null
2013-10-31 16:21:40,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000 dst=null perm=null
2013-10-31 16:21:40,108 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37005, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4902470675330313153_1436, duration: 257239
2013-10-31 16:21:40,108 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joingroupby
2013-10-31 16:21:40,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby dst=null perm=null
2013-10-31 16:21:40,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joingroupby/part-00000 dst=null perm=null
2013-10-31 16:21:40,116 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37006, bytes: 44, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-4902470675330313153_1436, duration: 256300
2013-10-31 16:21:40,134 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:21:40,135 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:21:40,151 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] starting
2013-10-31 16:21:40,151 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:21:40,152 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe"]
2013-10-31 16:21:40,152 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] parallel execution is enabled: true
2013-10-31 16:21:40,152 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] starting jobs: 1
2013-10-31 16:21:40,152 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower] allocating threads: 1
2013-10-31 16:21:40,153 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] starting step: (1/1) ...dedpipesplatform/samepipe
2013-10-31 16:21:40,158 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:21:40,159 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:21:40,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:40,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:21:40,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data6/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:40,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data5/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:40,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data6/current/blk_-6908714528030553586
2013-10-31 16:21:40,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data5/current/blk_-2094827360920713963
2013-10-31 16:21:40,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1425349623274254743_1431 file build/test/data/dfs/data/data6/current/blk_1425349623274254743 for deletion
2013-10-31 16:21:40,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2882572055122643041_1432 file build/test/data/dfs/data/data5/current/blk_2882572055122643041 for deletion
2013-10-31 16:21:40,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1425349623274254743_1431 at file build/test/data/dfs/data/data6/current/blk_1425349623274254743
2013-10-31 16:21:40,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2882572055122643041_1432 at file build/test/data/dfs/data/data5/current/blk_2882572055122643041
2013-10-31 16:21:40,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,185 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar. blk_5735244170345871603_1438
2013-10-31 16:21:40,187 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:50040 dest: /127.0.0.1:47311
2013-10-31 16:21:40,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:37008 dest: /127.0.0.1:38271
2013-10-31 16:21:40,190 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:57045 dest: /127.0.0.1:41648
2013-10-31 16:21:40,201 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57045, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5735244170345871603_1438, duration: 7267178
2013-10-31 16:21:40,201 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5735244170345871603_1438 terminating
2013-10-31 16:21:40,201 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:40,201 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37008, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5735244170345871603_1438, duration: 8155844
2013-10-31 16:21:40,202 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:40,202 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5735244170345871603_1438 terminating
2013-10-31 16:21:40,203 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50040, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5735244170345871603_1438, duration: 9274495
2013-10-31 16:21:40,203 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5735244170345871603_1438 terminating
2013-10-31 16:21:40,205 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar from client DFSClient_1457307213
2013-10-31 16:21:40,206 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar is closed by DFSClient_1457307213
2013-10-31 16:21:40,207 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:40,212 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar. New replication is 10
2013-10-31 16:21:40,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar dst=null perm=null
2013-10-31 16:21:40,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,224 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:21:40,229 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:21:40,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:40,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,244 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split. New replication is 10
2013-10-31 16:21:40,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=null
2013-10-31 16:21:40,251 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split. blk_3057745973757760936_1439
2013-10-31 16:21:40,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:57046 dest: /127.0.0.1:41648
2013-10-31 16:21:40,253 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:50044 dest: /127.0.0.1:47311
2013-10-31 16:21:40,254 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:36943 dest: /127.0.0.1:50942
2013-10-31 16:21:40,255 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3057745973757760936_1439 src: /127.0.0.1:37013 dest: /127.0.0.1:38271
2013-10-31 16:21:40,257 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37013, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3057745973757760936_1439, duration: 1072486
2013-10-31 16:21:40,258 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,258 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36943, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 573567
2013-10-31 16:21:40,259 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,259 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50044, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3057745973757760936_1439, duration: 1485383
2013-10-31 16:21:40,259 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,259 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57046, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3057745973757760936_1439, duration: 1895063
2013-10-31 16:21:40,260 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,260 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3057745973757760936_1439 terminating
2013-10-31 16:21:40,261 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,261 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split from client DFSClient_1457307213
2013-10-31 16:21:40,262 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split is closed by DFSClient_1457307213
2013-10-31 16:21:40,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3057745973757760936_1439 size 1732
2013-10-31 16:21:40,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,281 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo. blk_6822661847235725823_1440
2013-10-31 16:21:40,282 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6822661847235725823_1440 src: /127.0.0.1:36945 dest: /127.0.0.1:50942
2013-10-31 16:21:40,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6822661847235725823_1440 src: /127.0.0.1:50048 dest: /127.0.0.1:47311
2013-10-31 16:21:40,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6822661847235725823_1440 src: /127.0.0.1:57052 dest: /127.0.0.1:41648
2013-10-31 16:21:40,287 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57052, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6822661847235725823_1440, duration: 61518
2013-10-31 16:21:40,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6822661847235725823_1440 size 183
2013-10-31 16:21:40,288 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6822661847235725823_1440 terminating
2013-10-31 16:21:40,288 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50048, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6822661847235725823_1440, duration: 818225
2013-10-31 16:21:40,289 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6822661847235725823_1440 size 183
2013-10-31 16:21:40,289 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6822661847235725823_1440 terminating
2013-10-31 16:21:40,289 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36945, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6822661847235725823_1440, duration: 1765698
2013-10-31 16:21:40,290 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6822661847235725823_1440 size 183
2013-10-31 16:21:40,290 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6822661847235725823_1440 terminating
2013-10-31 16:21:40,292 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:21:40,293 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:21:40,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:40,313 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml. blk_6236331253892733936_1441
2013-10-31 16:21:40,314 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6236331253892733936_1441 src: /127.0.0.1:57053 dest: /127.0.0.1:41648
2013-10-31 16:21:40,315 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6236331253892733936_1441 src: /127.0.0.1:37018 dest: /127.0.0.1:38271
2013-10-31 16:21:40,316 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6236331253892733936_1441 src: /127.0.0.1:36950 dest: /127.0.0.1:50942
2013-10-31 16:21:40,318 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36950, dest: /127.0.0.1:50942, bytes: 27610, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6236331253892733936_1441, duration: 1024824
2013-10-31 16:21:40,318 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6236331253892733936_1441 terminating
2013-10-31 16:21:40,318 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37018, dest: /127.0.0.1:38271, bytes: 27610, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 779843
2013-10-31 16:21:40,319 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6236331253892733936_1441 terminating
2013-10-31 16:21:40,319 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57053, dest: /127.0.0.1:41648, bytes: 27610, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6236331253892733936_1441, duration: 1244475
2013-10-31 16:21:40,319 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6236331253892733936_1441 size 27610
2013-10-31 16:21:40,319 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6236331253892733936_1441 terminating
2013-10-31 16:21:40,321 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6236331253892733936_1441 size 27610
2013-10-31 16:21:40,321 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml from client DFSClient_1457307213
2013-10-31 16:21:40,321 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml is closed by DFSClient_1457307213
2013-10-31 16:21:40,323 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_6236331253892733936_1441 size 27610
2013-10-31 16:21:40,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml dst=null perm=null
2013-10-31 16:21:40,333 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37021, bytes: 27826, op: HDFS_READ, cliID: DFSClient_1423648074, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 165456
2013-10-31 16:21:40,350 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0038: nMaps=5 nReduces=0 max=-1
2013-10-31 16:21:40,350 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0038 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:21:40,350 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0038 RESULT=SUCCESS
2013-10-31 16:21:40,350 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0038
2013-10-31 16:21:40,350 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0038
2013-10-31 16:21:40,351 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower] submitted hadoop job: job_20131031160444934_0038
2013-10-31 16:21:41,538 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:41,538 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0037 being deleted.
2013-10-31 16:21:42,172 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6908714528030553586_1429 file build/test/data/dfs/data/data7/current/blk_-6908714528030553586 for deletion
2013-10-31 16:21:42,172 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2094827360920713963_1430 file build/test/data/dfs/data/data8/current/blk_-2094827360920713963 for deletion
2013-10-31 16:21:42,172 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6908714528030553586_1429 at file build/test/data/dfs/data/data7/current/blk_-6908714528030553586
2013-10-31 16:21:42,172 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1425349623274254743_1431 file build/test/data/dfs/data/data7/current/blk_1425349623274254743 for deletion
2013-10-31 16:21:42,172 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2094827360920713963_1430 at file build/test/data/dfs/data/data8/current/blk_-2094827360920713963
2013-10-31 16:21:42,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1425349623274254743_1431 at file build/test/data/dfs/data/data7/current/blk_1425349623274254743
2013-10-31 16:21:42,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2882572055122643041_1432 file build/test/data/dfs/data/data8/current/blk_2882572055122643041 for deletion
2013-10-31 16:21:42,174 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2882572055122643041_1432 at file build/test/data/dfs/data/data8/current/blk_2882572055122643041
2013-10-31 16:21:42,383 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_5735244170345871603_1438 to datanode(s) 127.0.0.1:50942
2013-10-31 16:21:42,383 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-5455871274990294667_1435
2013-10-31 16:21:42,383 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-5455871274990294667_1435
2013-10-31 16:21:42,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:42,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:42,440 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml. blk_1408456717703669255_1443
2013-10-31 16:21:42,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1408456717703669255_1443 src: /127.0.0.1:36953 dest: /127.0.0.1:50942
2013-10-31 16:21:42,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1408456717703669255_1443 src: /127.0.0.1:50056 dest: /127.0.0.1:47311
2013-10-31 16:21:42,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1408456717703669255_1443 src: /127.0.0.1:57060 dest: /127.0.0.1:41648
2013-10-31 16:21:42,450 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57060, dest: /127.0.0.1:41648, bytes: 27675, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1408456717703669255_1443, duration: 157448
2013-10-31 16:21:42,450 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1408456717703669255_1443 terminating
2013-10-31 16:21:42,451 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50056, dest: /127.0.0.1:47311, bytes: 27675, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1408456717703669255_1443, duration: 955375
2013-10-31 16:21:42,451 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1408456717703669255_1443 terminating
2013-10-31 16:21:42,452 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36953, dest: /127.0.0.1:50942, bytes: 27675, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1408456717703669255_1443, duration: 2092140
2013-10-31 16:21:42,452 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1408456717703669255_1443 terminating
2013-10-31 16:21:42,454 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1408456717703669255_1443 size 27675
2013-10-31 16:21:42,455 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml from client DFSClient_1423648074
2013-10-31 16:21:42,455 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_conf.xml is closed by DFSClient_1423648074
2013-10-31 16:21:42,456 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1408456717703669255_1443 size 27675
2013-10-31 16:21:42,456 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1408456717703669255_1443 size 27675
2013-10-31 16:21:42,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:42,469 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken. blk_5702328025413530424_1444
2013-10-31 16:21:42,471 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5702328025413530424_1444 src: /127.0.0.1:57061 dest: /127.0.0.1:41648
2013-10-31 16:21:42,472 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5702328025413530424_1444 src: /127.0.0.1:36957 dest: /127.0.0.1:50942
2013-10-31 16:21:42,474 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5702328025413530424_1444 src: /127.0.0.1:37027 dest: /127.0.0.1:38271
2013-10-31 16:21:42,477 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37027, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5702328025413530424_1444, duration: 64698
2013-10-31 16:21:42,477 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5702328025413530424_1444 terminating
2013-10-31 16:21:42,477 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36957, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5702328025413530424_1444, duration: 870010
2013-10-31 16:21:42,478 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5702328025413530424_1444 terminating
2013-10-31 16:21:42,478 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57061, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5702328025413530424_1444, duration: 1732791
2013-10-31 16:21:42,479 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5702328025413530424_1444 terminating
2013-10-31 16:21:42,482 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5702328025413530424_1444 size 116
2013-10-31 16:21:42,482 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken from client DFSClient_1457307213
2013-10-31 16:21:42,482 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken is closed by DFSClient_1457307213
2013-10-31 16:21:42,483 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5702328025413530424_1444 size 116
2013-10-31 16:21:42,483 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5702328025413530424_1444 size 116
2013-10-31 16:21:42,488 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken
2013-10-31 16:21:42,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.splitmetainfo dst=null perm=null
2013-10-31 16:21:42,492 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36959, bytes: 187, op: HDFS_READ, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6822661847235725823_1440, duration: 274117
2013-10-31 16:21:42,493 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0038 = 19. Number of splits = 5
2013-10-31 16:21:42,494 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,494 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,494 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,495 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,496 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0038_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:21:42,497 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0038 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:21:42,498 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0038 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:21:43,015 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0038_m_000006_0' to tip task_20131031160444934_0038_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:43,025 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:21:43,027 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000006_0 which needs 1 slots
2013-10-31 16:21:43,027 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000006_0 which needs 1 slots
2013-10-31 16:21:43,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken dst=null perm=null
2013-10-31 16:21:43,035 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36960, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5702328025413530424_1444, duration: 269489
2013-10-31 16:21:43,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml dst=null perm=null
2013-10-31 16:21:43,045 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37031, bytes: 27826, op: HDFS_READ, cliID: DFSClient_-1640699411, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 385818
2013-10-31 16:21:43,076 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:43,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar dst=null perm=null
2013-10-31 16:21:43,102 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37032, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1640699411, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5735244170345871603_1438, duration: 1235566
2013-10-31 16:21:43,178 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_5735244170345871603_1438 to 127.0.0.1:50942
2013-10-31 16:21:43,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5735244170345871603_1438 src: /127.0.0.1:36964 dest: /127.0.0.1:50942
2013-10-31 16:21:43,180 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_5735244170345871603_1438 to /127.0.0.1:50942
2013-10-31 16:21:43,181 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5735244170345871603_1438 src: /127.0.0.1:36964 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:21:43,186 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5735244170345871603_1438 size 238055
2013-10-31 16:21:43,187 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:43,194 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group894 with signal TERM. Exit code 0
2013-10-31 16:21:43,194 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:21:43,195 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-693609248 spawned.
2013-10-31 16:21:43,198 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000006_0/taskjvm.sh
2013-10-31 16:21:44,231 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0037_m_-719453515
2013-10-31 16:21:44,424 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:44,424 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:44,424 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:44,425 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_-719453515 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:21:44,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5455871274990294667_1435 file build/test/data/dfs/data/data2/current/blk_-5455871274990294667 for deletion
2013-10-31 16:21:44,963 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5455871274990294667_1435 at file build/test/data/dfs/data/data2/current/blk_-5455871274990294667
2013-10-31 16:21:45,007 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 96 raw values into 1 aggregated values, total 5
2013-10-31 16:21:45,011 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:45,011 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0037_m_000005_0 not found in cache
2013-10-31 16:21:45,012 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:45,012 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0037 for user-log deletion with retainTimeStamp:1383322905012
2013-10-31 16:21:45,012 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0037 for user-log deletion with retainTimeStamp:1383322905012
2013-10-31 16:21:45,013 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0037
2013-10-31 16:21:45,013 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0037 for user-log deletion with retainTimeStamp:1383322905013
2013-10-31 16:21:45,132 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-693609248 given task: attempt_20131031160444934_0038_m_000006_0
2013-10-31 16:21:45,172 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5455871274990294667_1435 file build/test/data/dfs/data/data7/current/blk_-5455871274990294667 for deletion
2013-10-31 16:21:45,173 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5455871274990294667_1435 at file build/test/data/dfs/data/data7/current/blk_-5455871274990294667
2013-10-31 16:21:45,350 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_r_206848199 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:45,355 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1330 with signal TERM. Exit code 0
2013-10-31 16:21:45,384 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-5455871274990294667_1435
2013-10-31 16:21:45,506 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:45,506 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:45,506 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:45,506 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_r_206848199 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:45,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:45,865 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_170743000 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:45,876 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1044 with signal TERM. Exit code 0
2013-10-31 16:21:46,047 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_-2116369040 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:46,052 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_1747797240 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:46,054 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,054 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,054 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:46,054 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_170743000 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:21:46,056 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1143 with signal TERM. Exit code 0
2013-10-31 16:21:46,057 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0037_m_2019793849 since job job_20131031160444934_0037 is dead
2013-10-31 16:21:46,063 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1144 with signal TERM. Exit code 0
2013-10-31 16:21:46,086 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1112 with signal TERM. Exit code 0
2013-10-31 16:21:46,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5455871274990294667_1435 file build/test/data/dfs/data/data6/current/blk_-5455871274990294667 for deletion
2013-10-31 16:21:46,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5455871274990294667_1435 at file build/test/data/dfs/data/data6/current/blk_-5455871274990294667
2013-10-31 16:21:46,269 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,269 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,269 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:46,269 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_-2116369040 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:46,279 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,279 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,279 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:46,279 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_1747797240 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:46,285 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:21:46,285 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:21:46,285 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:21:46,285 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0037_m_2019793849 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:21:48,576 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000006_0 0.0% setup
2013-10-31 16:21:48,579 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000006_0 is done.
2013-10-31 16:21:48,579 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000006_0 was -1
2013-10-31 16:21:48,579 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:49,032 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000006_0' has completed task_20131031160444934_0038_m_000006 successfully.
2013-10-31 16:21:49,036 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000000_0' to tip task_20131031160444934_0038_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:49,037 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000000
2013-10-31 16:21:49,037 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000001_0' to tip task_20131031160444934_0038_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:21:49,038 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000001
2013-10-31 16:21:49,040 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000002_0' to tip task_20131031160444934_0038_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:21:49,041 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:21:49,041 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000002
2013-10-31 16:21:49,042 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:21:49,042 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000003_0' to tip task_20131031160444934_0038_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:21:49,043 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000000_0 which needs 1 slots
2013-10-31 16:21:49,043 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000000_0 which needs 1 slots
2013-10-31 16:21:49,043 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000003
2013-10-31 16:21:49,043 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000001_0 which needs 1 slots
2013-10-31 16:21:49,044 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0038_m_000001_0 which needs 1 slots
2013-10-31 16:21:49,048 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:21:49,052 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:21:49,053 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000002_0 which needs 1 slots
2013-10-31 16:21:49,053 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000002_0 which needs 1 slots
2013-10-31 16:21:49,053 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000003_0 which needs 1 slots
2013-10-31 16:21:49,054 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0038_m_000003_0 which needs 1 slots
2013-10-31 16:21:49,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken dst=null perm=null
2013-10-31 16:21:49,063 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37036, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5702328025413530424_1444, duration: 291374
2013-10-31 16:21:49,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml dst=null perm=null
2013-10-31 16:21:49,074 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37038, bytes: 27826, op: HDFS_READ, cliID: DFSClient_1012918024, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_6236331253892733936_1441, duration: 375971
2013-10-31 16:21:49,096 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0038_m_000004_0' to tip task_20131031160444934_0038_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:49,096 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0038_m_000004
2013-10-31 16:21:49,099 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:21:49,099 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000004_0 which needs 1 slots
2013-10-31 16:21:49,099 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000004_0 which needs 1 slots
2013-10-31 16:21:49,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038/jobToken dst=null perm=null
2013-10-31 16:21:49,108 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37039, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5702328025413530424_1444, duration: 266969
2013-10-31 16:21:49,113 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-1882149955
2013-10-31 16:21:49,115 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-1882149955 spawned.
2013-10-31 16:21:49,116 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0038/attempt_20131031160444934_0038_m_000000_0. Attempting to reuse: jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:21:49,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.xml dst=null perm=null
2013-10-31 16:21:49,119 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000001_0/taskjvm.sh
2013-10-31 16:21:49,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36972, bytes: 27826, op: HDFS_READ, cliID: DFSClient_-430993833, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6236331253892733936_1441, duration: 403280
2013-10-31 16:21:49,126 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:49,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar dst=null perm=null
2013-10-31 16:21:49,153 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:21:49,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50075, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1012918024, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5735244170345871603_1438, duration: 590265
2013-10-31 16:21:49,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.jar dst=null perm=null
2013-10-31 16:21:49,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36974, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-430993833, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5735244170345871603_1438, duration: 591335
2013-10-31 16:21:49,342 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-1346237540
2013-10-31 16:21:49,344 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-1346237540 spawned.
2013-10-31 16:21:49,346 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-138801878
2013-10-31 16:21:49,346 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_-296060093
2013-10-31 16:21:49,347 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-138801878 spawned.
2013-10-31 16:21:49,348 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_-296060093 spawned.
2013-10-31 16:21:49,349 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000003_0/taskjvm.sh
2013-10-31 16:21:49,352 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000004_0/taskjvm.sh
2013-10-31 16:21:49,352 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000002_0/taskjvm.sh
2013-10-31 16:21:49,434 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-693609248 given task: attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:50,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=null
2013-10-31 16:21:50,205 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36976, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 166156
2013-10-31 16:21:50,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:50,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:50,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:50,470 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37046, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 137006
2013-10-31 16:21:50,476 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000. blk_7257285807569140874_1445
2013-10-31 16:21:50,491 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7257285807569140874_1445 src: /127.0.0.1:37047 dest: /127.0.0.1:38271
2013-10-31 16:21:50,492 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7257285807569140874_1445 src: /127.0.0.1:50081 dest: /127.0.0.1:47311
2013-10-31 16:21:50,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7257285807569140874_1445 src: /127.0.0.1:57085 dest: /127.0.0.1:41648
2013-10-31 16:21:50,495 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57085, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 1365565
2013-10-31 16:21:50,496 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7257285807569140874_1445 terminating
2013-10-31 16:21:50,496 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50081, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7257285807569140874_1445, duration: 1589738
2013-10-31 16:21:50,496 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7257285807569140874_1445 terminating
2013-10-31 16:21:50,496 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37047, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_7257285807569140874_1445, duration: 2178141
2013-10-31 16:21:50,497 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7257285807569140874_1445 terminating
2013-10-31 16:21:50,497 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_7257285807569140874_1445 size 8
2013-10-31 16:21:50,497 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7257285807569140874_1445 size 8
2013-10-31 16:21:50,498 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:50,498 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:50,499 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7257285807569140874_1445 size 8
2013-10-31 16:21:50,537 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:50,537 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000000_0 0.0%
2013-10-31 16:21:50,960 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-1882149955 given task: attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:50,966 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-1346237540 given task: attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:50,971 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-296060093 given task: attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:50,987 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_-138801878 given task: attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:51,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=null
2013-10-31 16:21:51,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=null
2013-10-31 16:21:51,485 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36989, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 512, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 162346
2013-10-31 16:21:51,487 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57095, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3057745973757760936_1439, duration: 165161
2013-10-31 16:21:51,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=null
2013-10-31 16:21:51,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038/job.split dst=null perm=null
2013-10-31 16:21:51,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50094, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3057745973757760936_1439, duration: 149943
2013-10-31 16:21:51,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36991, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3057745973757760936_1439, duration: 149438
2013-10-31 16:21:51,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:51,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:51,525 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50095, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8236244615419800290_1017, duration: 127299
2013-10-31 16:21:51,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37063, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 120469
2013-10-31 16:21:51,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:51,539 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:36995, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 109587
2013-10-31 16:21:51,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:51,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:21:51,542 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37065, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 101771
2013-10-31 16:21:51,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:51,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,046 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000000_0
2013-10-31 16:21:52,048 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002. blk_3508700753567488286_1447
2013-10-31 16:21:52,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3508700753567488286_1447 src: /127.0.0.1:37066 dest: /127.0.0.1:38271
2013-10-31 16:21:52,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3508700753567488286_1447 src: /127.0.0.1:50100 dest: /127.0.0.1:47311
2013-10-31 16:21:52,074 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3508700753567488286_1447 src: /127.0.0.1:36999 dest: /127.0.0.1:50942
2013-10-31 16:21:52,079 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:36999, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3508700753567488286_1447, duration: 3419106
2013-10-31 16:21:52,081 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3508700753567488286_1447 terminating
2013-10-31 16:21:52,083 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3508700753567488286_1447 size 8
2013-10-31 16:21:52,083 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50100, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3508700753567488286_1447, duration: 7297332
2013-10-31 16:21:52,084 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3508700753567488286_1447 terminating
2013-10-31 16:21:52,084 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37066, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3508700753567488286_1447, duration: 8230071
2013-10-31 16:21:52,085 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3508700753567488286_1447 size 8
2013-10-31 16:21:52,085 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3508700753567488286_1447 terminating
2013-10-31 16:21:52,086 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:52,086 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:52,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3508700753567488286_1447 size 8
2013-10-31 16:21:52,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:52,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:52,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,266 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,267 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000002_0 0.0%
2013-10-31 16:21:52,400 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003. blk_8666229121821947994_1449
2013-10-31 16:21:52,413 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004. blk_521913585338677058_1449
2013-10-31 16:21:52,419 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001. blk_7403056687973047624_1449
2013-10-31 16:21:52,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8666229121821947994_1449 src: /127.0.0.1:37000 dest: /127.0.0.1:50942
2013-10-31 16:21:52,424 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8666229121821947994_1449 src: /127.0.0.1:57108 dest: /127.0.0.1:41648
2013-10-31 16:21:52,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8666229121821947994_1449 src: /127.0.0.1:37073 dest: /127.0.0.1:38271
2013-10-31 16:21:52,427 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37073, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8666229121821947994_1449, duration: 1338311
2013-10-31 16:21:52,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8666229121821947994_1449 terminating
2013-10-31 16:21:52,428 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57108, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8666229121821947994_1449, duration: 1689289
2013-10-31 16:21:52,428 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8666229121821947994_1449 terminating
2013-10-31 16:21:52,428 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37000, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8666229121821947994_1449, duration: 2050800
2013-10-31 16:21:52,428 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8666229121821947994_1449 terminating
2013-10-31 16:21:52,430 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8666229121821947994_1449 size 8
2013-10-31 16:21:52,431 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8666229121821947994_1449 size 8
2013-10-31 16:21:52,432 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8666229121821947994_1449 size 8
2013-10-31 16:21:52,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7403056687973047624_1449 src: /127.0.0.1:50104 dest: /127.0.0.1:47311
2013-10-31 16:21:52,443 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7403056687973047624_1449 src: /127.0.0.1:57110 dest: /127.0.0.1:41648
2013-10-31 16:21:52,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7403056687973047624_1449 src: /127.0.0.1:37006 dest: /127.0.0.1:50942
2013-10-31 16:21:52,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_521913585338677058_1449 src: /127.0.0.1:50103 dest: /127.0.0.1:47311
2013-10-31 16:21:52,446 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37006, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_7403056687973047624_1449, duration: 1121032
2013-10-31 16:21:52,446 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_7403056687973047624_1449 size 8
2013-10-31 16:21:52,446 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7403056687973047624_1449 terminating
2013-10-31 16:21:52,446 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57110, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7403056687973047624_1449, duration: 1632066
2013-10-31 16:21:52,446 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7403056687973047624_1449 terminating
2013-10-31 16:21:52,447 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50104, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7403056687973047624_1449, duration: 2038354
2013-10-31 16:21:52,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_521913585338677058_1449 src: /127.0.0.1:37076 dest: /127.0.0.1:38271
2013-10-31 16:21:52,447 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7403056687973047624_1449 terminating
2013-10-31 16:21:52,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_521913585338677058_1449 src: /127.0.0.1:57113 dest: /127.0.0.1:41648
2013-10-31 16:21:52,448 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:52,448 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:52,449 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_7403056687973047624_1449 size 8
2013-10-31 16:21:52,449 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_7403056687973047624_1449 size 8
2013-10-31 16:21:52,450 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57113, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_521913585338677058_1449, duration: 1171221
2013-10-31 16:21:52,450 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_521913585338677058_1449 terminating
2013-10-31 16:21:52,450 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_521913585338677058_1449 size 8
2013-10-31 16:21:52,450 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37076, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_521913585338677058_1449, duration: 1512443
2013-10-31 16:21:52,450 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_521913585338677058_1449 terminating
2013-10-31 16:21:52,451 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50103, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0038_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_521913585338677058_1449, duration: 2078712
2013-10-31 16:21:52,451 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_521913585338677058_1449 terminating
2013-10-31 16:21:52,452 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:52,452 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:52,453 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_521913585338677058_1449 size 8
2013-10-31 16:21:52,453 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_521913585338677058_1449 size 8
2013-10-31 16:21:52,500 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,501 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000001_0 0.0%
2013-10-31 16:21:52,502 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,503 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000004_0 0.0%
2013-10-31 16:21:52,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0 dst=null perm=null
2013-10-31 16:21:52,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:52,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:52,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000000_0 dst=null perm=null
2013-10-31 16:21:52,830 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:52,831 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:52,897 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0038_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:21:52,897 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000003_0 0.0%
2013-10-31 16:21:53,161 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:21:53,163 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000000_0 is done.
2013-10-31 16:21:53,163 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000000_0 was -1
2013-10-31 16:21:53,163 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:54,043 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0038_m_000006_0
2013-10-31 16:21:54,043 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0038_m_000006_0
2013-10-31 16:21:54,043 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000006_0 not found in cache
2013-10-31 16:21:55,050 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000000_0' has completed task_20131031160444934_0038_m_000000 successfully.
2013-10-31 16:21:55,052 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000001_0
2013-10-31 16:21:55,054 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000002_0
2013-10-31 16:21:55,054 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000003_0
2013-10-31 16:21:55,107 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0038_m_000004_0
2013-10-31 16:21:55,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0 dst=null perm=null
2013-10-31 16:21:55,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:55,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:55,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000002_0 dst=null perm=null
2013-10-31 16:21:55,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0 dst=null perm=null
2013-10-31 16:21:55,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0 dst=null perm=null
2013-10-31 16:21:55,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:55,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:55,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:55,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:55,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000001_0 dst=null perm=null
2013-10-31 16:21:55,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000004_0 dst=null perm=null
2013-10-31 16:21:55,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0 dst=null perm=null
2013-10-31 16:21:55,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:21:56,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:56,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary/_attempt_20131031160444934_0038_m_000003_0 dst=null perm=null
2013-10-31 16:21:57,453 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:21:57,453 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:21:57,455 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:21:57,455 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:21:57,455 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:21:57,455 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000003_0 is done.
2013-10-31 16:21:57,455 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000003_0 was -1
2013-10-31 16:21:57,455 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000002_0 is done.
2013-10-31 16:21:57,456 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000002_0 was -1
2013-10-31 16:21:57,456 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:21:57,456 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:57,457 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:21:57,457 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000004_0 is done.
2013-10-31 16:21:57,457 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000004_0 was -1
2013-10-31 16:21:57,457 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:57,463 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:21:57,465 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:21:57,465 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000001_0 is done.
2013-10-31 16:21:57,465 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000001_0 was -1
2013-10-31 16:21:57,466 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:21:58,056 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000001_0' has completed task_20131031160444934_0038_m_000001 successfully.
2013-10-31 16:21:58,059 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000002_0' has completed task_20131031160444934_0038_m_000002 successfully.
2013-10-31 16:21:58,060 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000003_0' has completed task_20131031160444934_0038_m_000003 successfully.
2013-10-31 16:21:58,111 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000004_0' has completed task_20131031160444934_0038_m_000004 successfully.
2013-10-31 16:21:58,113 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0038_m_000005_0' to tip task_20131031160444934_0038_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:21:58,116 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0038_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:21:58,116 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0038_m_000005_0 which needs 1 slots
2013-10-31 16:21:58,116 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0038_m_000005_0 which needs 1 slots
2013-10-31 16:21:58,153 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0038_m_881681325
2013-10-31 16:21:58,154 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0038_m_881681325 spawned.
2013-10-31 16:21:58,156 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0038/attempt_20131031160444934_0038_m_000005_0/taskjvm.sh
2013-10-31 16:21:59,057 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0038_m_881681325 given task: attempt_20131031160444934_0038_m_000005_0
2013-10-31 16:21:59,597 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000005_0 0.0%
2013-10-31 16:21:59,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary dst=null perm=null
2013-10-31 16:21:59,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:21:59,622 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_SUCCESS from client DFSClient_attempt_20131031160444934_0038_m_000005_0
2013-10-31 16:21:59,622 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0038_m_000005_0
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5735244170345871603 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3057745973757760936 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:59,628 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6822661847235725823 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,629 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6822661847235725823 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:21:59,629 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6822661847235725823 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,629 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6236331253892733936 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:21:59,629 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6236331253892733936 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:21:59,629 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6236331253892733936 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:21:59,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0038 dst=null perm=null
2013-10-31 16:22:00,386 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_3057745973757760936_1439 blk_6822661847235725823_1440 blk_5735244170345871603_1438 blk_6236331253892733936_1441
2013-10-31 16:22:00,387 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_3057745973757760936_1439 blk_6822661847235725823_1440 blk_5735244170345871603_1438
2013-10-31 16:22:00,568 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data3/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:00,568 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data4/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:00,568 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data3/current/blk_3057745973757760936
2013-10-31 16:22:00,569 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6822661847235725823_1440 file build/test/data/dfs/data/data4/current/blk_6822661847235725823 for deletion
2013-10-31 16:22:00,569 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data4/current/blk_5735244170345871603
2013-10-31 16:22:00,569 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6822661847235725823_1440 at file build/test/data/dfs/data/data4/current/blk_6822661847235725823
2013-10-31 16:22:02,511 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0038_m_000005_0 0.0% cleanup
2013-10-31 16:22:02,513 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0038_m_000005_0 is done.
2013-10-31 16:22:02,513 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0038_m_000005_0 was -1
2013-10-31 16:22:02,513 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:03,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data7/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:03,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data8/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:03,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data7/current/blk_3057745973757760936
2013-10-31 16:22:03,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6236331253892733936_1441 file build/test/data/dfs/data/data7/current/blk_6236331253892733936 for deletion
2013-10-31 16:22:03,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data8/current/blk_5735244170345871603
2013-10-31 16:22:03,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6236331253892733936_1441 at file build/test/data/dfs/data/data7/current/blk_6236331253892733936
2013-10-31 16:22:03,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6822661847235725823_1440 file build/test/data/dfs/data/data8/current/blk_6822661847235725823 for deletion
2013-10-31 16:22:03,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6822661847235725823_1440 at file build/test/data/dfs/data/data8/current/blk_6822661847235725823
2013-10-31 16:22:03,387 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_3057745973757760936_1439 blk_6822661847235725823_1440 blk_5735244170345871603_1438 blk_6236331253892733936_1441
2013-10-31 16:22:03,387 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_3057745973757760936_1439 blk_5735244170345871603_1438 blk_6236331253892733936_1441
2013-10-31 16:22:04,123 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0038_m_000005_0' has completed task_20131031160444934_0038_m_000005 successfully.
2013-10-31 16:22:04,123 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0038 has completed successfully.
2013-10-31 16:22:04,123 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0038,submitTime=1383236500326,launchTime=1383236502497,firstMapTaskLaunchTime=1383236509036,firstJobSetupTaskLaunchTime=1383236503015,firstJobCleanupTaskLaunchTime=1383236518113,finishTime=1383236524123,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[944271F8E07F49FEA1EC679C06496DBC/AD8E6875136742E7B9682B8648BD7614] lower/(1/1) ...dedpipesplatform/samepipe
2013-10-31 16:22:04,128 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7. blk_3186721410777258518_1450
2013-10-31 16:22:04,130 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3186721410777258518_1450 src: /127.0.0.1:37083 dest: /127.0.0.1:38271
2013-10-31 16:22:04,131 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3186721410777258518_1450 src: /127.0.0.1:37015 dest: /127.0.0.1:50942
2013-10-31 16:22:04,133 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3186721410777258518_1450 src: /127.0.0.1:50118 dest: /127.0.0.1:47311
2013-10-31 16:22:04,156 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50118, dest: /127.0.0.1:47311, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3186721410777258518_1450, duration: 12396924
2013-10-31 16:22:04,157 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3186721410777258518_1450 terminating
2013-10-31 16:22:04,157 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37015, dest: /127.0.0.1:50942, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3186721410777258518_1450, duration: 13233511
2013-10-31 16:22:04,157 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3186721410777258518_1450 terminating
2013-10-31 16:22:04,158 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3186721410777258518_1450 size 26339
2013-10-31 16:22:04,159 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37083, dest: /127.0.0.1:38271, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1423648074, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3186721410777258518_1450, duration: 11443061
2013-10-31 16:22:04,159 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3186721410777258518_1450 terminating
2013-10-31 16:22:04,172 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3186721410777258518_1450 size 26339
2013-10-31 16:22:04,172 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7 from client DFSClient_1423648074
2013-10-31 16:22:04,173 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_logs/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7 is closed by DFSClient_1423648074
2013-10-31 16:22:04,173 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3186721410777258518_1450 size 26339
2013-10-31 16:22:04,180 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0038_1383236500326_hadoop_%5B944271F8E07F49FEA1EC679C06496DBC%2FAD8E6875136742E7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:04,181 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000004_0'
2013-10-31 16:22:04,181 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000005_0'
2013-10-31 16:22:04,182 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5702328025413530424 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:04,182 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5702328025413530424 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:04,183 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5702328025413530424 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:04,186 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0038_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:04,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data5/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:04,189 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data5/current/blk_3057745973757760936
2013-10-31 16:22:04,189 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data6/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:04,190 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6236331253892733936_1441 file build/test/data/dfs/data/data5/current/blk_6236331253892733936 for deletion
2013-10-31 16:22:04,190 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/_temporary
2013-10-31 16:22:04,190 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6236331253892733936_1441 at file build/test/data/dfs/data/data5/current/blk_6236331253892733936
2013-10-31 16:22:04,190 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6822661847235725823_1440 file build/test/data/dfs/data/data6/current/blk_6822661847235725823 for deletion
2013-10-31 16:22:04,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0038 dst=null perm=null
2013-10-31 16:22:04,190 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data6/current/blk_5735244170345871603
2013-10-31 16:22:04,191 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6822661847235725823_1440 at file build/test/data/dfs/data/data6/current/blk_6822661847235725823
2013-10-31 16:22:04,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=null
2013-10-31 16:22:04,248 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:04,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000 dst=null perm=null
2013-10-31 16:22:04,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001 dst=null perm=null
2013-10-31 16:22:04,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002 dst=null perm=null
2013-10-31 16:22:04,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003 dst=null perm=null
2013-10-31 16:22:04,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004 dst=null perm=null
2013-10-31 16:22:04,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000 dst=null perm=null
2013-10-31 16:22:04,256 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57123, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 141803
2013-10-31 16:22:04,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001 dst=null perm=null
2013-10-31 16:22:04,258 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50121, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_7403056687973047624_1449, duration: 106146
2013-10-31 16:22:04,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002 dst=null perm=null
2013-10-31 16:22:04,261 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37089, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3508700753567488286_1447, duration: 284805
2013-10-31 16:22:04,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003 dst=null perm=null
2013-10-31 16:22:04,263 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37090, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8666229121821947994_1449, duration: 112253
2013-10-31 16:22:04,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004 dst=null perm=null
2013-10-31 16:22:04,265 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57127, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_521913585338677058_1449, duration: 105927
2013-10-31 16:22:04,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=null
2013-10-31 16:22:04,283 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:04,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000 dst=null perm=null
2013-10-31 16:22:04,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001 dst=null perm=null
2013-10-31 16:22:04,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002 dst=null perm=null
2013-10-31 16:22:04,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003 dst=null perm=null
2013-10-31 16:22:04,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004 dst=null perm=null
2013-10-31 16:22:04,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000 dst=null perm=null
2013-10-31 16:22:04,290 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57128, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 263141
2013-10-31 16:22:04,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001 dst=null perm=null
2013-10-31 16:22:04,293 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57129, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7403056687973047624_1449, duration: 253280
2013-10-31 16:22:04,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002 dst=null perm=null
2013-10-31 16:22:04,296 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50127, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3508700753567488286_1447, duration: 268703
2013-10-31 16:22:04,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003 dst=null perm=null
2013-10-31 16:22:04,299 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37095, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8666229121821947994_1449, duration: 259818
2013-10-31 16:22:04,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004 dst=null perm=null
2013-10-31 16:22:04,302 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50129, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_521913585338677058_1449, duration: 251217
2013-10-31 16:22:04,302 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/samepipe
2013-10-31 16:22:04,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe dst=null perm=null
2013-10-31 16:22:04,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00000 dst=null perm=null
2013-10-31 16:22:04,311 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57133, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7257285807569140874_1445, duration: 354002
2013-10-31 16:22:04,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00001 dst=null perm=null
2013-10-31 16:22:04,315 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57134, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_7403056687973047624_1449, duration: 249994
2013-10-31 16:22:04,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00002 dst=null perm=null
2013-10-31 16:22:04,319 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37099, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3508700753567488286_1447, duration: 260533
2013-10-31 16:22:04,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00003 dst=null perm=null
2013-10-31 16:22:04,323 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57136, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8666229121821947994_1449, duration: 260179
2013-10-31 16:22:04,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/samepipe/part-00004 dst=null perm=null
2013-10-31 16:22:04,328 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50134, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_521913585338677058_1449, duration: 243950
2013-10-31 16:22:04,350 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:22:04,350 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:22:04,361 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:22:04,361 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt"]
2013-10-31 16:22:04,362 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt"]
2013-10-31 16:22:04,362 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter"]
2013-10-31 16:22:04,363 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:22:04,363 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:22:04,363 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:22:04,364 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...esplatform/joininnerouter
2013-10-31 16:22:04,367 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:22:04,367 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:22:04,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:04,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:22:04,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,413 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar. blk_-597700145908871906_1451
2013-10-31 16:22:04,414 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:57138 dest: /127.0.0.1:41648
2013-10-31 16:22:04,416 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:37103 dest: /127.0.0.1:38271
2013-10-31 16:22:04,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:37035 dest: /127.0.0.1:50942
2013-10-31 16:22:04,425 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37035, dest: /127.0.0.1:50942, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-597700145908871906_1451, duration: 3855195
2013-10-31 16:22:04,425 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-597700145908871906_1451 terminating
2013-10-31 16:22:04,427 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:04,446 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37103, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-597700145908871906_1451, duration: 5025458
2013-10-31 16:22:04,447 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-597700145908871906_1451 terminating
2013-10-31 16:22:04,450 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57138, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-597700145908871906_1451, duration: 26324049
2013-10-31 16:22:04,450 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:04,451 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-597700145908871906_1451 terminating
2013-10-31 16:22:04,453 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar from client DFSClient_1457307213
2013-10-31 16:22:04,454 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar is closed by DFSClient_1457307213
2013-10-31 16:22:04,454 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:04,467 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar. New replication is 10
2013-10-31 16:22:04,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar dst=null perm=null
2013-10-31 16:22:04,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,487 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:22:04,491 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:22:04,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:22:04,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,514 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split. New replication is 10
2013-10-31 16:22:04,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=null
2013-10-31 16:22:04,523 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split. blk_8675290507838488823_1452
2013-10-31 16:22:04,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:37105 dest: /127.0.0.1:38271
2013-10-31 16:22:04,526 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:57142 dest: /127.0.0.1:41648
2013-10-31 16:22:04,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:37038 dest: /127.0.0.1:50942
2013-10-31 16:22:04,530 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8675290507838488823_1452 src: /127.0.0.1:50141 dest: /127.0.0.1:47311
2013-10-31 16:22:04,533 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50141, dest: /127.0.0.1:47311, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8675290507838488823_1452, duration: 82128
2013-10-31 16:22:04,533 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,534 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37038, dest: /127.0.0.1:50942, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8675290507838488823_1452, duration: 850907
2013-10-31 16:22:04,534 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,535 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57142, dest: /127.0.0.1:41648, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8675290507838488823_1452, duration: 1778546
2013-10-31 16:22:04,535 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,536 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37105, dest: /127.0.0.1:38271, bytes: 1757, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8675290507838488823_1452, duration: 2863862
2013-10-31 16:22:04,536 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8675290507838488823_1452 terminating
2013-10-31 16:22:04,539 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,539 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split from client DFSClient_1457307213
2013-10-31 16:22:04,540 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split is closed by DFSClient_1457307213
2013-10-31 16:22:04,540 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,541 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,541 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_8675290507838488823_1452 size 1757
2013-10-31 16:22:04,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:04,560 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo. blk_-1884129492925356079_1453
2013-10-31 16:22:04,562 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1884129492925356079_1453 src: /127.0.0.1:57145 dest: /127.0.0.1:41648
2013-10-31 16:22:04,563 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1884129492925356079_1453 src: /127.0.0.1:50143 dest: /127.0.0.1:47311
2013-10-31 16:22:04,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1884129492925356079_1453 src: /127.0.0.1:37043 dest: /127.0.0.1:50942
2013-10-31 16:22:04,568 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37043, dest: /127.0.0.1:50942, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1884129492925356079_1453, duration: 1198207
2013-10-31 16:22:04,568 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1884129492925356079_1453 terminating
2013-10-31 16:22:04,568 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50143, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1884129492925356079_1453, duration: 875934
2013-10-31 16:22:04,569 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1884129492925356079_1453 terminating
2013-10-31 16:22:04,569 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57145, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1884129492925356079_1453, duration: 1684766
2013-10-31 16:22:04,570 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-1884129492925356079_1453 size 183
2013-10-31 16:22:04,570 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1884129492925356079_1453 terminating
2013-10-31 16:22:04,572 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1884129492925356079_1453 size 183
2013-10-31 16:22:04,572 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:22:04,573 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:22:04,573 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1884129492925356079_1453 size 183
2013-10-31 16:22:05,561 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:05,561 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0038 being deleted.
2013-10-31 16:22:05,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,812 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2422 Total time for transactions(ms): 53Number of transactions batched in Syncs: 268 Number of syncs: 1739 SyncTimes(ms): 83893 16993
2013-10-31 16:22:05,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,825 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml. blk_-4918846354399814783_1454
2013-10-31 16:22:05,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4918846354399814783_1454 src: /127.0.0.1:37044 dest: /127.0.0.1:50942
2013-10-31 16:22:05,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4918846354399814783_1454 src: /127.0.0.1:57150 dest: /127.0.0.1:41648
2013-10-31 16:22:05,831 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4918846354399814783_1454 src: /127.0.0.1:50148 dest: /127.0.0.1:47311
2013-10-31 16:22:05,834 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50148, dest: /127.0.0.1:47311, bytes: 28980, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4918846354399814783_1454, duration: 221307
2013-10-31 16:22:05,835 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4918846354399814783_1454 terminating
2013-10-31 16:22:05,835 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57150, dest: /127.0.0.1:41648, bytes: 28980, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4918846354399814783_1454, duration: 1132463
2013-10-31 16:22:05,835 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4918846354399814783_1454 terminating
2013-10-31 16:22:05,836 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-4918846354399814783_1454 size 28980
2013-10-31 16:22:05,836 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37044, dest: /127.0.0.1:50942, bytes: 28980, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4918846354399814783_1454, duration: 1969516
2013-10-31 16:22:05,836 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4918846354399814783_1454 terminating
2013-10-31 16:22:05,836 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-4918846354399814783_1454 size 28980
2013-10-31 16:22:05,838 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml from client DFSClient_1457307213
2013-10-31 16:22:05,839 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml is closed by DFSClient_1457307213
2013-10-31 16:22:05,840 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-4918846354399814783_1454 size 28980
2013-10-31 16:22:05,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml dst=null perm=null
2013-10-31 16:22:05,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50150, bytes: 29208, op: HDFS_READ, cliID: DFSClient_516062909, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-4918846354399814783_1454, duration: 406187
2013-10-31 16:22:05,871 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0039: nMaps=5 nReduces=0 max=-1
2013-10-31 16:22:05,871 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0039 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:22:05,871 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0039 RESULT=SUCCESS
2013-10-31 16:22:05,871 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0039
2013-10-31 16:22:05,871 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0039
2013-10-31 16:22:05,872 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0039
2013-10-31 16:22:05,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,905 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml. blk_-3551340103892272393_1456
2013-10-31 16:22:05,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3551340103892272393_1456 src: /127.0.0.1:37118 dest: /127.0.0.1:38271
2013-10-31 16:22:05,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3551340103892272393_1456 src: /127.0.0.1:57155 dest: /127.0.0.1:41648
2013-10-31 16:22:05,909 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3551340103892272393_1456 src: /127.0.0.1:37051 dest: /127.0.0.1:50942
2013-10-31 16:22:05,914 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37051, dest: /127.0.0.1:50942, bytes: 29045, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3551340103892272393_1456, duration: 733852
2013-10-31 16:22:05,914 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3551340103892272393_1456 terminating
2013-10-31 16:22:05,915 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57155, dest: /127.0.0.1:41648, bytes: 29045, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3551340103892272393_1456, duration: 1871546
2013-10-31 16:22:05,915 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3551340103892272393_1456 size 29045
2013-10-31 16:22:05,915 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3551340103892272393_1456 terminating
2013-10-31 16:22:05,916 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37118, dest: /127.0.0.1:38271, bytes: 29045, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3551340103892272393_1456, duration: 2698831
2013-10-31 16:22:05,916 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3551340103892272393_1456 size 29045
2013-10-31 16:22:05,916 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3551340103892272393_1456 terminating
2013-10-31 16:22:05,921 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3551340103892272393_1456 size 29045
2013-10-31 16:22:05,921 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml from client DFSClient_516062909
2013-10-31 16:22:05,921 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_conf.xml is closed by DFSClient_516062909
2013-10-31 16:22:05,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:05,935 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken. blk_3283441132058347550_1457
2013-10-31 16:22:05,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3283441132058347550_1457 src: /127.0.0.1:37052 dest: /127.0.0.1:50942
2013-10-31 16:22:05,939 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3283441132058347550_1457 src: /127.0.0.1:57158 dest: /127.0.0.1:41648
2013-10-31 16:22:05,940 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3283441132058347550_1457 src: /127.0.0.1:50156 dest: /127.0.0.1:47311
2013-10-31 16:22:05,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50156, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3283441132058347550_1457, duration: 64322
2013-10-31 16:22:05,943 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3283441132058347550_1457 terminating
2013-10-31 16:22:05,944 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57158, dest: /127.0.0.1:41648, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 819066
2013-10-31 16:22:05,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3283441132058347550_1457 terminating
2013-10-31 16:22:05,945 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37052, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3283441132058347550_1457, duration: 1732414
2013-10-31 16:22:05,945 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3283441132058347550_1457 terminating
2013-10-31 16:22:05,947 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3283441132058347550_1457 size 116
2013-10-31 16:22:05,947 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken from client DFSClient_1457307213
2013-10-31 16:22:05,948 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken is closed by DFSClient_1457307213
2013-10-31 16:22:05,948 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_3283441132058347550_1457 size 116
2013-10-31 16:22:05,949 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3283441132058347550_1457 size 116
2013-10-31 16:22:05,954 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken
2013-10-31 16:22:05,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.splitmetainfo dst=null perm=null
2013-10-31 16:22:05,959 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57160, bytes: 187, op: HDFS_READ, cliID: DFSClient_516062909, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-1884129492925356079_1453, duration: 459078
2013-10-31 16:22:05,960 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0039 = 83. Number of splits = 5
2013-10-31 16:22:05,960 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,960 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,961 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,962 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,963 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:05,964 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0039 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:22:05,964 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0039 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:22:05,970 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3057745973757760936_1439 file build/test/data/dfs/data/data2/current/blk_3057745973757760936 for deletion
2013-10-31 16:22:05,970 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5735244170345871603_1438 file build/test/data/dfs/data/data1/current/blk_5735244170345871603 for deletion
2013-10-31 16:22:05,970 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3057745973757760936_1439 at file build/test/data/dfs/data/data2/current/blk_3057745973757760936
2013-10-31 16:22:05,970 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6236331253892733936_1441 file build/test/data/dfs/data/data1/current/blk_6236331253892733936 for deletion
2013-10-31 16:22:05,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5735244170345871603_1438 at file build/test/data/dfs/data/data1/current/blk_5735244170345871603
2013-10-31 16:22:05,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6236331253892733936_1441 at file build/test/data/dfs/data/data1/current/blk_6236331253892733936
2013-10-31 16:22:06,388 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-597700145908871906_1451 to datanode(s) 127.0.0.1:47311
2013-10-31 16:22:06,389 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_5702328025413530424_1444
2013-10-31 16:22:06,389 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_5702328025413530424_1444
2013-10-31 16:22:07,070 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0039_m_000006_0' to tip task_20131031160444934_0039_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:07,075 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000000_0'
2013-10-31 16:22:07,075 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000001_0'
2013-10-31 16:22:07,075 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000006_0'
2013-10-31 16:22:07,078 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:22:07,078 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000002_0'
2013-10-31 16:22:07,078 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000006_0 which needs 1 slots
2013-10-31 16:22:07,079 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0038_m_000003_0'
2013-10-31 16:22:07,079 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000006_0 which needs 1 slots
2013-10-31 16:22:07,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken dst=null perm=null
2013-10-31 16:22:07,087 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57161, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 279116
2013-10-31 16:22:07,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml dst=null perm=null
2013-10-31 16:22:07,097 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37058, bytes: 29208, op: HDFS_READ, cliID: DFSClient_597924467, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-4918846354399814783_1454, duration: 474909
2013-10-31 16:22:07,128 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:07,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar dst=null perm=null
2013-10-31 16:22:07,159 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57164, bytes: 239915, op: HDFS_READ, cliID: DFSClient_597924467, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-597700145908871906_1451, duration: 1276476
2013-10-31 16:22:07,187 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-597700145908871906_1451 to 127.0.0.1:47311
2013-10-31 16:22:07,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5702328025413530424_1444 file build/test/data/dfs/data/data5/current/subdir63/blk_5702328025413530424 for deletion
2013-10-31 16:22:07,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5702328025413530424_1444 at file build/test/data/dfs/data/data5/current/subdir63/blk_5702328025413530424
2013-10-31 16:22:07,189 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-597700145908871906_1451 src: /127.0.0.1:50162 dest: /127.0.0.1:47311
2013-10-31 16:22:07,189 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-597700145908871906_1451 to /127.0.0.1:47311
2013-10-31 16:22:07,190 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-597700145908871906_1451 src: /127.0.0.1:50162 dest: /127.0.0.1:47311 of size 238055
2013-10-31 16:22:07,195 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-597700145908871906_1451 size 238055
2013-10-31 16:22:07,258 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0038_m_-1882149955
2013-10-31 16:22:07,264 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1738 with signal TERM. Exit code 0
2013-10-31 16:22:07,265 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_-410323460
2013-10-31 16:22:07,265 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_-410323460 spawned.
2013-10-31 16:22:07,268 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000006_0/taskjvm.sh
2013-10-31 16:22:07,348 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:07,348 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:07,348 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:07,348 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-1882149955 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:08,970 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5702328025413530424_1444 file build/test/data/dfs/data/data2/current/blk_5702328025413530424 for deletion
2013-10-31 16:22:08,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5702328025413530424_1444 at file build/test/data/dfs/data/data2/current/blk_5702328025413530424
2013-10-31 16:22:09,182 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:09,182 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000005_0 not found in cache
2013-10-31 16:22:09,182 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000004_0 not found in cache
2013-10-31 16:22:09,183 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0038 for user-log deletion with retainTimeStamp:1383322929183
2013-10-31 16:22:09,284 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-410323460 given task: attempt_20131031160444934_0039_m_000006_0
2013-10-31 16:22:09,389 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_5702328025413530424_1444
2013-10-31 16:22:09,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:09,988 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_-296060093 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:09,996 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1737 with signal TERM. Exit code 0
2013-10-31 16:22:10,181 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:10,182 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:10,182 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:10,182 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-296060093 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:10,576 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_881681325 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:10,587 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2042 with signal TERM. Exit code 0
2013-10-31 16:22:10,767 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:10,767 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:10,767 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:10,768 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_881681325 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:12,079 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:12,079 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000001_0 not found in cache
2013-10-31 16:22:12,079 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000000_0 not found in cache
2013-10-31 16:22:12,079 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0038
2013-10-31 16:22:12,080 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000002_0 not found in cache
2013-10-31 16:22:12,080 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0038 for user-log deletion with retainTimeStamp:1383322932080
2013-10-31 16:22:12,080 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0038_m_000003_0 not found in cache
2013-10-31 16:22:12,081 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0038 for user-log deletion with retainTimeStamp:1383322932081
2013-10-31 16:22:12,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5702328025413530424_1444 file build/test/data/dfs/data/data7/current/blk_5702328025413530424 for deletion
2013-10-31 16:22:12,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5702328025413530424_1444 at file build/test/data/dfs/data/data7/current/blk_5702328025413530424
2013-10-31 16:22:12,713 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000006_0 0.0% setup
2013-10-31 16:22:12,716 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000006_0 is done.
2013-10-31 16:22:12,716 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000006_0 was -1
2013-10-31 16:22:12,716 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:12,989 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_-138801878 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:12,999 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1739 with signal TERM. Exit code 0
2013-10-31 16:22:13,000 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0038_m_-1346237540 since job job_20131031160444934_0038 is dead
2013-10-31 16:22:13,011 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1736 with signal TERM. Exit code 0
2013-10-31 16:22:13,084 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000006_0' has completed task_20131031160444934_0039_m_000006 successfully.
2013-10-31 16:22:13,085 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000000_0' to tip task_20131031160444934_0039_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:13,086 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000000
2013-10-31 16:22:13,086 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000001_0' to tip task_20131031160444934_0039_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:13,086 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000001
2013-10-31 16:22:13,087 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000002_0' to tip task_20131031160444934_0039_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:13,087 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:22:13,087 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000002
2013-10-31 16:22:13,088 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:22:13,088 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000000_0 which needs 1 slots
2013-10-31 16:22:13,088 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000000_0 which needs 1 slots
2013-10-31 16:22:13,088 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000003_0' to tip task_20131031160444934_0039_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:13,088 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000001_0 which needs 1 slots
2013-10-31 16:22:13,088 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0039_m_000001_0 which needs 1 slots
2013-10-31 16:22:13,089 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000003
2013-10-31 16:22:13,093 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:22:13,093 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:22:13,093 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000002_0 which needs 1 slots
2013-10-31 16:22:13,094 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000002_0 which needs 1 slots
2013-10-31 16:22:13,094 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000003_0 which needs 1 slots
2013-10-31 16:22:13,094 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0039_m_000003_0 which needs 1 slots
2013-10-31 16:22:13,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken dst=null perm=null
2013-10-31 16:22:13,099 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57168, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 257734
2013-10-31 16:22:13,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml dst=null perm=null
2013-10-31 16:22:13,105 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57170, bytes: 29208, op: HDFS_READ, cliID: DFSClient_-409063308, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4918846354399814783_1454, duration: 317338
2013-10-31 16:22:13,111 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0039/attempt_20131031160444934_0039_m_000001_0. Attempting to reuse: jvm_20131031160444934_0039_m_-410323460
2013-10-31 16:22:13,117 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:22:13,119 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:13,121 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1547 with signal TERM. Exit code 0
2013-10-31 16:22:13,122 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_814554802
2013-10-31 16:22:13,122 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_814554802 spawned.
2013-10-31 16:22:13,124 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000000_0/taskjvm.sh
2013-10-31 16:22:13,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar dst=null perm=null
2013-10-31 16:22:13,136 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57171, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-409063308, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-597700145908871906_1451, duration: 951939
2013-10-31 16:22:13,188 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:13,188 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:13,188 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:13,188 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-1346237540 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:13,190 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0039_m_000004_0' to tip task_20131031160444934_0039_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:13,191 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0039_m_000004
2013-10-31 16:22:13,192 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:22:13,192 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000004_0 which needs 1 slots
2013-10-31 16:22:13,192 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:13,192 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:13,192 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:13,192 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000004_0 which needs 1 slots
2013-10-31 16:22:13,192 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-138801878 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:13,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039/jobToken dst=null perm=null
2013-10-31 16:22:13,196 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57172, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_3283441132058347550_1457, duration: 137837
2013-10-31 16:22:13,198 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_868079514
2013-10-31 16:22:13,200 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_868079514 spawned.
2013-10-31 16:22:13,200 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_-1078247713
2013-10-31 16:22:13,202 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_-1078247713 spawned.
2013-10-31 16:22:13,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.xml dst=null perm=null
2013-10-31 16:22:13,204 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000002_0/taskjvm.sh
2013-10-31 16:22:13,204 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000003_0/taskjvm.sh
2013-10-31 16:22:13,205 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57174, bytes: 29208, op: HDFS_READ, cliID: DFSClient_-791114546, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-4918846354399814783_1454, duration: 194635
2013-10-31 16:22:13,213 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031160444934_0038_m_-693609248
2013-10-31 16:22:13,218 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:13,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.jar dst=null perm=null
2013-10-31 16:22:13,235 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37139, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-791114546, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-597700145908871906_1451, duration: 1339348
2013-10-31 16:22:13,342 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_79344705
2013-10-31 16:22:13,342 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_79344705 spawned.
2013-10-31 16:22:13,343 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000004_0/taskjvm.sh
2013-10-31 16:22:13,523 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-410323460 given task: attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:13,580 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:13,580 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:13,580 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:13,580 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0038_m_-693609248 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:22:13,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=null
2013-10-31 16:22:13,628 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57177, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8675290507838488823_1452, duration: 173788
2013-10-31 16:22:13,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:22:13,669 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50175, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 114133
2013-10-31 16:22:14,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:14,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:14,199 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_814554802 given task: attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:14,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:14,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:14,437 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57180, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 141593
2013-10-31 16:22:14,448 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001. blk_1428969296953013366_1458
2013-10-31 16:22:14,464 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1428969296953013366_1458 src: /127.0.0.1:57181 dest: /127.0.0.1:41648
2013-10-31 16:22:15,059 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1428969296953013366_1458 src: /127.0.0.1:37077 dest: /127.0.0.1:50942
2013-10-31 16:22:15,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1428969296953013366_1458 src: /127.0.0.1:37147 dest: /127.0.0.1:38271
2013-10-31 16:22:15,116 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37147, dest: /127.0.0.1:38271, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1428969296953013366_1458, duration: 1812962
2013-10-31 16:22:15,120 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1428969296953013366_1458 size 37
2013-10-31 16:22:15,120 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1428969296953013366_1458 terminating
2013-10-31 16:22:15,120 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37077, dest: /127.0.0.1:50942, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1428969296953013366_1458, duration: 5608814
2013-10-31 16:22:15,120 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1428969296953013366_1458 terminating
2013-10-31 16:22:15,120 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57181, dest: /127.0.0.1:41648, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000001_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1428969296953013366_1458, duration: 6049176
2013-10-31 16:22:15,121 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1428969296953013366_1458 terminating
2013-10-31 16:22:15,123 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1428969296953013366_1458 size 37
2013-10-31 16:22:15,123 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:15,123 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:15,124 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1428969296953013366_1458 size 37
2013-10-31 16:22:15,162 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:15,162 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000001_0 0.0%
2013-10-31 16:22:15,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=null
2013-10-31 16:22:15,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57185, bytes: 1773, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_8675290507838488823_1452, duration: 185056
2013-10-31 16:22:15,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:22:15,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:15,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:15,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:15,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:15,643 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37150, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 132253
2013-10-31 16:22:15,647 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57187, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 160115
2013-10-31 16:22:15,657 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000. blk_-880140191113664544_1459
2013-10-31 16:22:15,679 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-880140191113664544_1459 src: /127.0.0.1:57188 dest: /127.0.0.1:41648
2013-10-31 16:22:15,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-880140191113664544_1459 src: /127.0.0.1:50186 dest: /127.0.0.1:47311
2013-10-31 16:22:15,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-880140191113664544_1459 src: /127.0.0.1:37154 dest: /127.0.0.1:38271
2013-10-31 16:22:15,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37154, dest: /127.0.0.1:38271, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-880140191113664544_1459, duration: 1036978
2013-10-31 16:22:15,683 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-880140191113664544_1459 terminating
2013-10-31 16:22:15,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50186, dest: /127.0.0.1:47311, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-880140191113664544_1459, duration: 1494176
2013-10-31 16:22:15,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-880140191113664544_1459 terminating
2013-10-31 16:22:15,684 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-880140191113664544_1459 size 120
2013-10-31 16:22:15,684 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57188, dest: /127.0.0.1:41648, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-880140191113664544_1459, duration: 1882377
2013-10-31 16:22:15,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-880140191113664544_1459 terminating
2013-10-31 16:22:15,685 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:15,685 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:15,686 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-880140191113664544_1459 size 120
2013-10-31 16:22:15,687 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-880140191113664544_1459 size 120
2013-10-31 16:22:15,893 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-1078247713 given task: attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:15,908 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_79344705 given task: attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:15,910 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_868079514 given task: attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:16,090 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000001_0
2013-10-31 16:22:16,113 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:16,113 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000000_0 0.0%
2013-10-31 16:22:16,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0 dst=null perm=null
2013-10-31 16:22:16,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000001_0 dst=null perm=null
2013-10-31 16:22:16,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=null
2013-10-31 16:22:16,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=null
2013-10-31 16:22:16,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039/job.split dst=null perm=null
2013-10-31 16:22:16,413 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50194, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8675290507838488823_1452, duration: 169194
2013-10-31 16:22:16,414 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37162, bytes: 1257, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 512, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8675290507838488823_1452, duration: 204206
2013-10-31 16:22:16,415 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50196, bytes: 741, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 1024, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_8675290507838488823_1452, duration: 150070
2013-10-31 16:22:16,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50197, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-8193683770357719291_1366, duration: 109821
2013-10-31 16:22:16,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57201, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 114359
2013-10-31 16:22:16,454 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57202, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-8193683770357719291_1366, duration: 103244
2013-10-31 16:22:16,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:16,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:16,586 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:20+20
2013-10-31 16:22:16,587 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000001_0 is done.
2013-10-31 16:22:16,587 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000001_0 was -1
2013-10-31 16:22:16,587 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:16,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37167, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_863628976355473469_1367, duration: 136105
2013-10-31 16:22:16,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2013-10-31 16:22:16,720 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57204, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 110055
2013-10-31 16:22:16,722 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57205, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_863628976355473469_1367, duration: 106715
2013-10-31 16:22:16,726 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002. blk_-3766852199179531138_1462
2013-10-31 16:22:16,733 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004. blk_2307814493574241169_1462
2013-10-31 16:22:16,735 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003. blk_2408232434680552120_1462
2013-10-31 16:22:16,750 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3766852199179531138_1462 src: /127.0.0.1:50203 dest: /127.0.0.1:47311
2013-10-31 16:22:16,750 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3766852199179531138_1462 src: /127.0.0.1:57209 dest: /127.0.0.1:41648
2013-10-31 16:22:16,751 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3766852199179531138_1462 src: /127.0.0.1:37174 dest: /127.0.0.1:38271
2013-10-31 16:22:16,758 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2307814493574241169_1462 src: /127.0.0.1:50204 dest: /127.0.0.1:47311
2013-10-31 16:22:16,758 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37174, dest: /127.0.0.1:38271, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3766852199179531138_1462, duration: 4900253
2013-10-31 16:22:16,758 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3766852199179531138_1462 terminating
2013-10-31 16:22:16,758 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57209, dest: /127.0.0.1:41648, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3766852199179531138_1462, duration: 6315418
2013-10-31 16:22:16,759 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3766852199179531138_1462 terminating
2013-10-31 16:22:16,759 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2307814493574241169_1462 src: /127.0.0.1:57211 dest: /127.0.0.1:41648
2013-10-31 16:22:16,759 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50203, dest: /127.0.0.1:47311, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3766852199179531138_1462, duration: 6845133
2013-10-31 16:22:16,759 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3766852199179531138_1462 terminating
2013-10-31 16:22:16,760 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2307814493574241169_1462 src: /127.0.0.1:37176 dest: /127.0.0.1:38271
2013-10-31 16:22:16,760 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2408232434680552120_1462 src: /127.0.0.1:37103 dest: /127.0.0.1:50942
2013-10-31 16:22:16,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2408232434680552120_1462 src: /127.0.0.1:50210 dest: /127.0.0.1:47311
2013-10-31 16:22:16,762 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3766852199179531138_1462 size 28
2013-10-31 16:22:16,763 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3766852199179531138_1462 size 28
2013-10-31 16:22:16,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2408232434680552120_1462 src: /127.0.0.1:57214 dest: /127.0.0.1:41648
2013-10-31 16:22:16,763 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37176, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2307814493574241169_1462, duration: 1699249
2013-10-31 16:22:16,763 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-3766852199179531138_1462 size 28
2013-10-31 16:22:16,763 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2307814493574241169_1462 terminating
2013-10-31 16:22:16,763 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57211, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2307814493574241169_1462, duration: 2411201
2013-10-31 16:22:16,764 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2307814493574241169_1462 terminating
2013-10-31 16:22:16,764 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50204, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2307814493574241169_1462, duration: 3029250
2013-10-31 16:22:16,764 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2307814493574241169_1462 terminating
2013-10-31 16:22:16,766 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57214, dest: /127.0.0.1:41648, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2408232434680552120_1462, duration: 798589
2013-10-31 16:22:16,766 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2408232434680552120_1462 terminating
2013-10-31 16:22:16,766 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2307814493574241169_1462 size 8
2013-10-31 16:22:16,767 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50210, dest: /127.0.0.1:47311, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2408232434680552120_1462, duration: 2069995
2013-10-31 16:22:16,767 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2307814493574241169_1462 size 8
2013-10-31 16:22:16,767 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2408232434680552120_1462 terminating
2013-10-31 16:22:16,767 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_2408232434680552120_1462 size 28
2013-10-31 16:22:16,767 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_2408232434680552120_1462 size 28
2013-10-31 16:22:16,767 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_2307814493574241169_1462 size 8
2013-10-31 16:22:16,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37103, dest: /127.0.0.1:50942, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0039_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2408232434680552120_1462, duration: 2648139
2013-10-31 16:22:16,769 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2408232434680552120_1462 terminating
2013-10-31 16:22:16,769 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:16,770 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:16,771 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_2408232434680552120_1462 size 28
2013-10-31 16:22:16,825 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:16,825 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000003_0 0.0%
2013-10-31 16:22:17,161 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:17,162 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:17,167 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:17,167 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:17,220 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:17,220 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000002_0 0.0%
2013-10-31 16:22:17,222 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0039_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:17,222 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000004_0 0.0%
2013-10-31 16:22:18,088 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0039_m_000006_0
2013-10-31 16:22:18,089 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0039_m_000006_0
2013-10-31 16:22:18,089 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000006_0 not found in cache
2013-10-31 16:22:19,094 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000001_0' has completed task_20131031160444934_0039_m_000001 successfully.
2013-10-31 16:22:19,097 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000000_0
2013-10-31 16:22:19,099 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000002_0
2013-10-31 16:22:19,100 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000003_0
2013-10-31 16:22:19,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0 dst=null perm=null
2013-10-31 16:22:19,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000000_0 dst=null perm=null
2013-10-31 16:22:19,197 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0039_m_000004_0
2013-10-31 16:22:19,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0 dst=null perm=null
2013-10-31 16:22:19,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0 dst=null perm=null
2013-10-31 16:22:19,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000002_0 dst=null perm=null
2013-10-31 16:22:19,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000004_0 dst=null perm=null
2013-10-31 16:22:19,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0 dst=null perm=null
2013-10-31 16:22:19,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:19,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:19,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary/_attempt_20131031160444934_0039_m_000003_0 dst=null perm=null
2013-10-31 16:22:21,317 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:22:21,322 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:0+20
2013-10-31 16:22:21,323 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000000_0 is done.
2013-10-31 16:22:21,323 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000000_0 was -1
2013-10-31 16:22:21,324 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:22,101 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000000_0' has completed task_20131031160444934_0039_m_000000 successfully.
2013-10-31 16:22:22,409 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:22:22,411 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:60+20
2013-10-31 16:22:22,412 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000003_0 is done.
2013-10-31 16:22:22,412 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000003_0 was -1
2013-10-31 16:22:22,412 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:22,415 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:22:22,418 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:22:22,424 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:80+3
2013-10-31 16:22:22,425 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lhs-sparse.txt:40+20
2013-10-31 16:22:22,426 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000004_0 is done.
2013-10-31 16:22:22,426 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000004_0 was -1
2013-10-31 16:22:22,426 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:22,428 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000002_0 is done.
2013-10-31 16:22:22,428 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000002_0 was -1
2013-10-31 16:22:22,429 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:25,108 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000002_0' has completed task_20131031160444934_0039_m_000002 successfully.
2013-10-31 16:22:25,110 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000003_0' has completed task_20131031160444934_0039_m_000003 successfully.
2013-10-31 16:22:25,204 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000004_0' has completed task_20131031160444934_0039_m_000004 successfully.
2013-10-31 16:22:25,206 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0039_m_000005_0' to tip task_20131031160444934_0039_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:25,209 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0039_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:22:25,209 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0039_m_000005_0 which needs 1 slots
2013-10-31 16:22:25,209 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0039_m_000005_0 which needs 1 slots
2013-10-31 16:22:25,239 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0039_m_-1907135464
2013-10-31 16:22:25,240 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0039_m_-1907135464 spawned.
2013-10-31 16:22:25,243 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0039/attempt_20131031160444934_0039_m_000005_0/taskjvm.sh
2013-10-31 16:22:26,203 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0039_m_-1907135464 given task: attempt_20131031160444934_0039_m_000005_0
2013-10-31 16:22:26,737 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000005_0 0.0%
2013-10-31 16:22:26,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary dst=null perm=null
2013-10-31 16:22:26,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:26,756 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_SUCCESS from client DFSClient_attempt_20131031160444934_0039_m_000005_0
2013-10-31 16:22:26,756 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0039_m_000005_0
2013-10-31 16:22:26,762 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,762 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:26,762 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-597700145908871906 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8675290507838488823 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1884129492925356079 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1884129492925356079 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1884129492925356079 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4918846354399814783 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4918846354399814783 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:26,763 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4918846354399814783 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:26,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0039 dst=null perm=null
2013-10-31 16:22:27,392 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_-597700145908871906_1451 blk_8675290507838488823_1452
2013-10-31 16:22:27,393 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-1884129492925356079_1453 blk_-597700145908871906_1451 blk_-4918846354399814783_1454 blk_8675290507838488823_1452
2013-10-31 16:22:29,648 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0039_m_000005_0 0.0% cleanup
2013-10-31 16:22:29,650 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0039_m_000005_0 is done.
2013-10-31 16:22:29,650 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0039_m_000005_0 was -1
2013-10-31 16:22:29,650 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:29,977 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data2/current/subdir17/blk_-597700145908871906 for deletion
2013-10-31 16:22:29,977 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data1/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:29,978 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data1/current/blk_8675290507838488823
2013-10-31 16:22:29,978 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data2/current/subdir17/blk_-597700145908871906
2013-10-31 16:22:30,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4918846354399814783_1454 file build/test/data/dfs/data/data8/current/blk_-4918846354399814783 for deletion
2013-10-31 16:22:30,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1884129492925356079_1453 file build/test/data/dfs/data/data7/current/blk_-1884129492925356079 for deletion
2013-10-31 16:22:30,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data7/current/blk_-597700145908871906 for deletion
2013-10-31 16:22:30,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4918846354399814783_1454 at file build/test/data/dfs/data/data8/current/blk_-4918846354399814783
2013-10-31 16:22:30,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data8/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:30,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1884129492925356079_1453 at file build/test/data/dfs/data/data7/current/blk_-1884129492925356079
2013-10-31 16:22:30,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data8/current/blk_8675290507838488823
2013-10-31 16:22:30,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data7/current/blk_-597700145908871906
2013-10-31 16:22:30,393 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_-1884129492925356079_1453 blk_-597700145908871906_1451 blk_-4918846354399814783_1454 blk_8675290507838488823_1452
2013-10-31 16:22:30,394 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_-1884129492925356079_1453 blk_-597700145908871906_1451 blk_-4918846354399814783_1454 blk_8675290507838488823_1452
2013-10-31 16:22:30,578 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4918846354399814783_1454 file build/test/data/dfs/data/data3/current/blk_-4918846354399814783 for deletion
2013-10-31 16:22:30,578 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1884129492925356079_1453 file build/test/data/dfs/data/data4/current/blk_-1884129492925356079 for deletion
2013-10-31 16:22:30,579 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4918846354399814783_1454 at file build/test/data/dfs/data/data3/current/blk_-4918846354399814783
2013-10-31 16:22:30,579 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1884129492925356079_1453 at file build/test/data/dfs/data/data4/current/blk_-1884129492925356079
2013-10-31 16:22:30,579 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data3/current/blk_-597700145908871906 for deletion
2013-10-31 16:22:30,579 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data3/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:30,580 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data3/current/blk_-597700145908871906
2013-10-31 16:22:30,580 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data3/current/blk_8675290507838488823
2013-10-31 16:22:31,195 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4918846354399814783_1454 file build/test/data/dfs/data/data5/current/blk_-4918846354399814783 for deletion
2013-10-31 16:22:31,195 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1884129492925356079_1453 file build/test/data/dfs/data/data6/current/blk_-1884129492925356079 for deletion
2013-10-31 16:22:31,195 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4918846354399814783_1454 at file build/test/data/dfs/data/data5/current/blk_-4918846354399814783
2013-10-31 16:22:31,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1884129492925356079_1453 at file build/test/data/dfs/data/data6/current/blk_-1884129492925356079
2013-10-31 16:22:31,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-597700145908871906_1451 file build/test/data/dfs/data/data6/current/blk_-597700145908871906 for deletion
2013-10-31 16:22:31,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8675290507838488823_1452 file build/test/data/dfs/data/data5/current/blk_8675290507838488823 for deletion
2013-10-31 16:22:31,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-597700145908871906_1451 at file build/test/data/dfs/data/data6/current/blk_-597700145908871906
2013-10-31 16:22:31,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8675290507838488823_1452 at file build/test/data/dfs/data/data5/current/blk_8675290507838488823
2013-10-31 16:22:31,216 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0039_m_000005_0' has completed task_20131031160444934_0039_m_000005 successfully.
2013-10-31 16:22:31,217 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0039 has completed successfully.
2013-10-31 16:22:31,217 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0039,submitTime=1383236525844,launchTime=1383236525964,firstMapTaskLaunchTime=1383236533085,firstJobSetupTaskLaunchTime=1383236527069,firstJobCleanupTaskLaunchTime=1383236545206,finishTime=1383236551217,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=49,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[85B27853B09F4D76BC826C6F41287464/D443F64090B247EEAF88909CD7C78242] lower*upper/(1/1) ...esplatform/joininnerouter
2013-10-31 16:22:31,222 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE. blk_6789732992266141191_1463
2013-10-31 16:22:31,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6789732992266141191_1463 src: /127.0.0.1:57220 dest: /127.0.0.1:41648
2013-10-31 16:22:31,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6789732992266141191_1463 src: /127.0.0.1:50218 dest: /127.0.0.1:47311
2013-10-31 16:22:31,230 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6789732992266141191_1463 src: /127.0.0.1:37117 dest: /127.0.0.1:50942
2013-10-31 16:22:31,239 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37117, dest: /127.0.0.1:50942, bytes: 26426, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_6789732992266141191_1463, duration: 5129216
2013-10-31 16:22:31,240 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6789732992266141191_1463 terminating
2013-10-31 16:22:31,240 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50218, dest: /127.0.0.1:47311, bytes: 26426, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_6789732992266141191_1463, duration: 5278128
2013-10-31 16:22:31,241 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6789732992266141191_1463 terminating
2013-10-31 16:22:31,241 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_6789732992266141191_1463 size 26426
2013-10-31 16:22:31,241 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57220, dest: /127.0.0.1:41648, bytes: 26426, op: HDFS_WRITE, cliID: DFSClient_516062909, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_6789732992266141191_1463, duration: 6598844
2013-10-31 16:22:31,242 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6789732992266141191_1463 terminating
2013-10-31 16:22:31,242 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_6789732992266141191_1463 size 26426
2013-10-31 16:22:31,245 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE from client DFSClient_516062909
2013-10-31 16:22:31,245 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_logs/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE is closed by DFSClient_516062909
2013-10-31 16:22:31,246 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_6789732992266141191_1463 size 26426
2013-10-31 16:22:31,253 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0039_1383236525844_hadoop_%5B85B27853B09F4D76BC826C6F41287464%2FD443F64090B247EE to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:31,254 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000004_0'
2013-10-31 16:22:31,254 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000005_0'
2013-10-31 16:22:31,256 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3283441132058347550 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:31,256 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3283441132058347550 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:31,256 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3283441132058347550 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:31,262 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0039_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:31,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0039 dst=null perm=null
2013-10-31 16:22:31,262 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/_temporary
2013-10-31 16:22:31,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=null
2013-10-31 16:22:31,283 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:31,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000 dst=null perm=null
2013-10-31 16:22:31,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001 dst=null perm=null
2013-10-31 16:22:31,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002 dst=null perm=null
2013-10-31 16:22:31,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003 dst=null perm=null
2013-10-31 16:22:31,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004 dst=null perm=null
2013-10-31 16:22:31,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000 dst=null perm=null
2013-10-31 16:22:31,293 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37188, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-880140191113664544_1459, duration: 275753
2013-10-31 16:22:31,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001 dst=null perm=null
2013-10-31 16:22:31,297 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57225, bytes: 41, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1428969296953013366_1458, duration: 254565
2013-10-31 16:22:31,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002 dst=null perm=null
2013-10-31 16:22:31,301 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37190, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3766852199179531138_1462, duration: 267654
2013-10-31 16:22:31,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003 dst=null perm=null
2013-10-31 16:22:31,304 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57227, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2408232434680552120_1462, duration: 250572
2013-10-31 16:22:31,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004 dst=null perm=null
2013-10-31 16:22:31,307 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37192, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_2307814493574241169_1462, duration: 249179
2013-10-31 16:22:31,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=null
2013-10-31 16:22:31,325 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:31,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000 dst=null perm=null
2013-10-31 16:22:31,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001 dst=null perm=null
2013-10-31 16:22:31,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002 dst=null perm=null
2013-10-31 16:22:31,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003 dst=null perm=null
2013-10-31 16:22:31,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004 dst=null perm=null
2013-10-31 16:22:31,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000 dst=null perm=null
2013-10-31 16:22:31,335 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57229, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-880140191113664544_1459, duration: 261171
2013-10-31 16:22:31,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001 dst=null perm=null
2013-10-31 16:22:31,339 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57230, bytes: 41, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1428969296953013366_1458, duration: 257533
2013-10-31 16:22:31,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002 dst=null perm=null
2013-10-31 16:22:31,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50228, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3766852199179531138_1462, duration: 254165
2013-10-31 16:22:31,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003 dst=null perm=null
2013-10-31 16:22:31,346 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50229, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_2408232434680552120_1462, duration: 254201
2013-10-31 16:22:31,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004 dst=null perm=null
2013-10-31 16:22:31,349 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57233, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2307814493574241169_1462, duration: 258439
2013-10-31 16:22:31,349 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/joininnerouter
2013-10-31 16:22:31,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter dst=null perm=null
2013-10-31 16:22:31,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00000 dst=null perm=null
2013-10-31 16:22:31,355 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37198, bytes: 124, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-880140191113664544_1459, duration: 281171
2013-10-31 16:22:31,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00001 dst=null perm=null
2013-10-31 16:22:31,358 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37199, bytes: 41, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1428969296953013366_1458, duration: 144601
2013-10-31 16:22:31,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00002 dst=null perm=null
2013-10-31 16:22:31,360 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57236, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-3766852199179531138_1462, duration: 112426
2013-10-31 16:22:31,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00003 dst=null perm=null
2013-10-31 16:22:31,363 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37132, bytes: 32, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_2408232434680552120_1462, duration: 106175
2013-10-31 16:22:31,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/joininnerouter/part-00004 dst=null perm=null
2013-10-31 16:22:31,365 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57238, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_2307814493574241169_1462, duration: 109203
2013-10-31 16:22:31,374 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 16:22:31,374 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 16:22:31,385 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting
2013-10-31 16:22:31,385 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt"]
2013-10-31 16:22:31,386 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt"]
2013-10-31 16:22:31,386 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields"]
2013-10-31 16:22:31,386 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] parallel execution is enabled: true
2013-10-31 16:22:31,387 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] starting jobs: 1
2013-10-31 16:22:31,387 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower*upper] allocating threads: 1
2013-10-31 16:22:31,388 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] starting step: (1/1) ...dpipesplatform/difffields
2013-10-31 16:22:31,391 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 16:22:31,391 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 16:22:31,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:31,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 16:22:31,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,420 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar. blk_-7119918970507031873_1464
2013-10-31 16:22:31,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:57239 dest: /127.0.0.1:41648
2013-10-31 16:22:31,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:37204 dest: /127.0.0.1:38271
2013-10-31 16:22:31,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:50238 dest: /127.0.0.1:47311
2013-10-31 16:22:31,437 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50238, dest: /127.0.0.1:47311, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7119918970507031873_1464, duration: 7170011
2013-10-31 16:22:31,437 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7119918970507031873_1464 terminating
2013-10-31 16:22:31,438 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37204, dest: /127.0.0.1:38271, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119918970507031873_1464, duration: 8016447
2013-10-31 16:22:31,438 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7119918970507031873_1464 terminating
2013-10-31 16:22:31,438 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57239, dest: /127.0.0.1:41648, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7119918970507031873_1464, duration: 8837336
2013-10-31 16:22:31,439 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7119918970507031873_1464 terminating
2013-10-31 16:22:31,442 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:31,442 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar from client DFSClient_1457307213
2013-10-31 16:22:31,443 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar is closed by DFSClient_1457307213
2013-10-31 16:22:31,443 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:31,443 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:31,452 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar. New replication is 10
2013-10-31 16:22:31,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar dst=null perm=null
2013-10-31 16:22:31,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,471 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 16:22:31,475 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 16:22:31,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:22:31,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:31,493 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split. New replication is 10
2013-10-31 16:22:32,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=null
2013-10-31 16:22:32,494 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split. blk_4065104606401556411_1465
2013-10-31 16:22:32,496 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:50239 dest: /127.0.0.1:47311
2013-10-31 16:22:32,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:57243 dest: /127.0.0.1:41648
2013-10-31 16:22:32,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:37139 dest: /127.0.0.1:50942
2013-10-31 16:22:32,501 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4065104606401556411_1465 src: /127.0.0.1:37209 dest: /127.0.0.1:38271
2013-10-31 16:22:32,504 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37209, dest: /127.0.0.1:38271, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4065104606401556411_1465, duration: 121186
2013-10-31 16:22:32,504 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,505 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37139, dest: /127.0.0.1:50942, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4065104606401556411_1465, duration: 965915
2013-10-31 16:22:32,506 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,506 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,506 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57243, dest: /127.0.0.1:41648, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4065104606401556411_1465, duration: 2213696
2013-10-31 16:22:32,507 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,507 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50239, dest: /127.0.0.1:47311, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4065104606401556411_1465, duration: 3243831
2013-10-31 16:22:32,507 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4065104606401556411_1465 terminating
2013-10-31 16:22:32,508 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,509 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split from client DFSClient_1457307213
2013-10-31 16:22:32,510 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split is closed by DFSClient_1457307213
2013-10-31 16:22:32,510 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,511 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4065104606401556411_1465 size 1732
2013-10-31 16:22:32,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,535 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo. blk_4703071415899710414_1466
2013-10-31 16:22:32,536 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4703071415899710414_1466 src: /127.0.0.1:37210 dest: /127.0.0.1:38271
2013-10-31 16:22:32,538 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4703071415899710414_1466 src: /127.0.0.1:50244 dest: /127.0.0.1:47311
2013-10-31 16:22:32,539 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4703071415899710414_1466 src: /127.0.0.1:57248 dest: /127.0.0.1:41648
2013-10-31 16:22:32,542 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57248, dest: /127.0.0.1:41648, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4703071415899710414_1466, duration: 67241
2013-10-31 16:22:32,543 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4703071415899710414_1466 terminating
2013-10-31 16:22:32,543 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50244, dest: /127.0.0.1:47311, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4703071415899710414_1466, duration: 873659
2013-10-31 16:22:32,544 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4703071415899710414_1466 terminating
2013-10-31 16:22:32,544 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37210, dest: /127.0.0.1:38271, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4703071415899710414_1466, duration: 1726818
2013-10-31 16:22:32,545 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4703071415899710414_1466 terminating
2013-10-31 16:22:32,547 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_4703071415899710414_1466 size 183
2013-10-31 16:22:32,547 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_4703071415899710414_1466 size 183
2013-10-31 16:22:32,548 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_4703071415899710414_1466 size 183
2013-10-31 16:22:32,590 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:32,590 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031160444934_0039 being deleted.
2013-10-31 16:22:32,947 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo from client DFSClient_1457307213
2013-10-31 16:22:32,948 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo is closed by DFSClient_1457307213
2013-10-31 16:22:32,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:32,977 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml. blk_1832285968670934940_1467
2013-10-31 16:22:32,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1832285968670934940_1467 src: /127.0.0.1:50246 dest: /127.0.0.1:47311
2013-10-31 16:22:32,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1832285968670934940_1467 src: /127.0.0.1:57250 dest: /127.0.0.1:41648
2013-10-31 16:22:32,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1832285968670934940_1467 src: /127.0.0.1:37215 dest: /127.0.0.1:38271
2013-10-31 16:22:32,984 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37215, dest: /127.0.0.1:38271, bytes: 28267, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_1832285968670934940_1467, duration: 110396
2013-10-31 16:22:32,985 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1832285968670934940_1467 terminating
2013-10-31 16:22:32,985 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57250, dest: /127.0.0.1:41648, bytes: 28267, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 950603
2013-10-31 16:22:32,986 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1832285968670934940_1467 terminating
2013-10-31 16:22:32,986 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50246, dest: /127.0.0.1:47311, bytes: 28267, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1832285968670934940_1467, duration: 2003687
2013-10-31 16:22:32,987 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1832285968670934940_1467 size 28267
2013-10-31 16:22:32,987 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1832285968670934940_1467 terminating
2013-10-31 16:22:32,989 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_1832285968670934940_1467 size 28267
2013-10-31 16:22:32,989 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml from client DFSClient_1457307213
2013-10-31 16:22:32,989 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml is closed by DFSClient_1457307213
2013-10-31 16:22:32,990 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1832285968670934940_1467 size 28267
2013-10-31 16:22:33,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml dst=null perm=null
2013-10-31 16:22:33,006 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50250, bytes: 28491, op: HDFS_READ, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1832285968670934940_1467, duration: 397686
2013-10-31 16:22:33,024 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031160444934_0040: nMaps=5 nReduces=0 max=-1
2013-10-31 16:22:33,025 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031160444934_0040 added successfully for user 'hadoop' to queue 'default'
2013-10-31 16:22:33,025 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031160444934_0040
2013-10-31 16:22:33,025 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031160444934_0040 RESULT=SUCCESS
2013-10-31 16:22:33,025 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031160444934_0040
2013-10-31 16:22:33,026 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower*upper] submitted hadoop job: job_20131031160444934_0040
2013-10-31 16:22:33,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:33,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:33,060 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml. blk_-1904464405163911237_1469
2013-10-31 16:22:33,062 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1904464405163911237_1469 src: /127.0.0.1:37218 dest: /127.0.0.1:38271
2013-10-31 16:22:33,064 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1904464405163911237_1469 src: /127.0.0.1:37150 dest: /127.0.0.1:50942
2013-10-31 16:22:33,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1904464405163911237_1469 src: /127.0.0.1:50253 dest: /127.0.0.1:47311
2013-10-31 16:22:33,069 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50253, dest: /127.0.0.1:47311, bytes: 28332, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-1904464405163911237_1469, duration: 536060
2013-10-31 16:22:33,069 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1904464405163911237_1469 terminating
2013-10-31 16:22:33,070 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37150, dest: /127.0.0.1:50942, bytes: 28332, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-1904464405163911237_1469, duration: 1426402
2013-10-31 16:22:33,071 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1904464405163911237_1469 terminating
2013-10-31 16:22:33,071 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-1904464405163911237_1469 size 28332
2013-10-31 16:22:33,071 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37218, dest: /127.0.0.1:38271, bytes: 28332, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-1904464405163911237_1469, duration: 2605158
2013-10-31 16:22:33,072 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1904464405163911237_1469 terminating
2013-10-31 16:22:33,073 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml from client DFSClient_1064441706
2013-10-31 16:22:33,074 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_conf.xml is closed by DFSClient_1064441706
2013-10-31 16:22:33,075 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-1904464405163911237_1469 size 28332
2013-10-31 16:22:33,075 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-1904464405163911237_1469 size 28332
2013-10-31 16:22:33,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:33,088 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken. blk_-3316025396248904415_1470
2013-10-31 16:22:33,090 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3316025396248904415_1470 src: /127.0.0.1:37152 dest: /127.0.0.1:50942
2013-10-31 16:22:33,092 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3316025396248904415_1470 src: /127.0.0.1:50255 dest: /127.0.0.1:47311
2013-10-31 16:22:33,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3316025396248904415_1470 src: /127.0.0.1:37223 dest: /127.0.0.1:38271
2013-10-31 16:22:33,096 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37223, dest: /127.0.0.1:38271, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3316025396248904415_1470, duration: 65003
2013-10-31 16:22:33,096 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3316025396248904415_1470 terminating
2013-10-31 16:22:33,097 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50255, dest: /127.0.0.1:47311, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-3316025396248904415_1470, duration: 832195
2013-10-31 16:22:33,097 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3316025396248904415_1470 terminating
2013-10-31 16:22:33,098 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37152, dest: /127.0.0.1:50942, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3316025396248904415_1470, duration: 1630867
2013-10-31 16:22:33,098 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3316025396248904415_1470 terminating
2013-10-31 16:22:33,100 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_-3316025396248904415_1470 size 116
2013-10-31 16:22:33,100 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken from client DFSClient_1457307213
2013-10-31 16:22:33,101 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken is closed by DFSClient_1457307213
2013-10-31 16:22:33,101 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-3316025396248904415_1470 size 116
2013-10-31 16:22:33,102 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-3316025396248904415_1470 size 116
2013-10-31 16:22:33,106 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken
2013-10-31 16:22:33,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.splitmetainfo dst=null perm=null
2013-10-31 16:22:33,110 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57260, bytes: 187, op: HDFS_READ, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4703071415899710414_1466, duration: 271447
2013-10-31 16:22:33,111 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031160444934_0040 = 19. Number of splits = 5
2013-10-31 16:22:33,111 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,112 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,113 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,114 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,115 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,115 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031160444934_0040_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 16:22:33,115 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031160444934_0040 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 16:22:33,115 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031160444934_0040 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 16:22:33,395 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:41648 to replicate blk_-7119918970507031873_1464 to datanode(s) 127.0.0.1:50942
2013-10-31 16:22:33,395 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:41648 to delete blk_3283441132058347550_1457
2013-10-31 16:22:33,395 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:47311 to delete blk_3283441132058347550_1457
2013-10-31 16:22:33,579 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3283441132058347550_1457 file build/test/data/dfs/data/data4/current/blk_3283441132058347550 for deletion
2013-10-31 16:22:33,579 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3283441132058347550_1457 at file build/test/data/dfs/data/data4/current/blk_3283441132058347550
2013-10-31 16:22:34,118 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031160444934_0040_m_000006_0' to tip task_20131031160444934_0040_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:34,123 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000000_0'
2013-10-31 16:22:34,123 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000001_0'
2013-10-31 16:22:34,123 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000006_0'
2013-10-31 16:22:34,125 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000006_0 task's state:UNASSIGNED
2013-10-31 16:22:34,126 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000006_0 which needs 1 slots
2013-10-31 16:22:34,126 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000006_0 which needs 1 slots
2013-10-31 16:22:34,127 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000002_0'
2013-10-31 16:22:34,128 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0039_m_000003_0'
2013-10-31 16:22:34,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken dst=null perm=null
2013-10-31 16:22:34,135 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37159, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-3316025396248904415_1470, duration: 299695
2013-10-31 16:22:34,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml dst=null perm=null
2013-10-31 16:22:34,146 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57266, bytes: 28491, op: HDFS_READ, cliID: DFSClient_251345186, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 383352
2013-10-31 16:22:34,176 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:34,195 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454) Starting thread to transfer block blk_-7119918970507031873_1464 to 127.0.0.1:50942
2013-10-31 16:22:34,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3283441132058347550_1457 file build/test/data/dfs/data/data5/current/subdir63/blk_3283441132058347550 for deletion
2013-10-31 16:22:34,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3283441132058347550_1457 at file build/test/data/dfs/data/data5/current/subdir63/blk_3283441132058347550
2013-10-31 16:22:34,197 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:41648, storageID=DS-1634612289-10.5.128.102-41648-1383235482785, infoPort=45464, ipcPort=44454):Transmitted block blk_-7119918970507031873_1464 to /127.0.0.1:50942
2013-10-31 16:22:34,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7119918970507031873_1464 src: /127.0.0.1:37162 dest: /127.0.0.1:50942
2013-10-31 16:22:34,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar dst=null perm=null
2013-10-31 16:22:34,200 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-7119918970507031873_1464 src: /127.0.0.1:37162 dest: /127.0.0.1:50942 of size 238055
2013-10-31 16:22:34,202 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37232, bytes: 239915, op: HDFS_READ, cliID: DFSClient_251345186, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119918970507031873_1464, duration: 1224963
2013-10-31 16:22:34,205 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7119918970507031873_1464 size 238055
2013-10-31 16:22:34,314 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031160444934_0039_m_-410323460
2013-10-31 16:22:34,322 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2229 with signal TERM. Exit code 0
2013-10-31 16:22:34,322 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_29028229
2013-10-31 16:22:34,323 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_29028229 spawned.
2013-10-31 16:22:34,326 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000006_0/taskjvm.sh
2013-10-31 16:22:35,024 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:35,024 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:35,024 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:35,024 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_-410323460 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 16:22:35,780 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_29028229 given task: attempt_20131031160444934_0040_m_000006_0
2013-10-31 16:22:36,256 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:36,256 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000005_0 not found in cache
2013-10-31 16:22:36,256 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000004_0 not found in cache
2013-10-31 16:22:36,257 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0039 for user-log deletion with retainTimeStamp:1383322956257
2013-10-31 16:22:36,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:36,396 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_3283441132058347550_1457
2013-10-31 16:22:36,463 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_79344705 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:36,474 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2524 with signal TERM. Exit code 0
2013-10-31 16:22:36,647 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:36,648 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:36,648 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:36,648 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_79344705 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:37,716 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_-1907135464 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:37,726 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2779 with signal TERM. Exit code 0
2013-10-31 16:22:37,888 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:37,888 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:37,888 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:37,888 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_-1907135464 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:39,126 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:39,126 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000000_0 not found in cache
2013-10-31 16:22:39,126 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000001_0 not found in cache
2013-10-31 16:22:39,127 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0039 for user-log deletion with retainTimeStamp:1383322959127
2013-10-31 16:22:39,129 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031160444934_0039
2013-10-31 16:22:39,129 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000003_0 not found in cache
2013-10-31 16:22:39,129 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0039_m_000002_0 not found in cache
2013-10-31 16:22:39,130 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031160444934_0039 for user-log deletion with retainTimeStamp:1383322959130
2013-10-31 16:22:39,190 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3283441132058347550_1457 file build/test/data/dfs/data/data8/current/blk_3283441132058347550 for deletion
2013-10-31 16:22:39,191 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3283441132058347550_1457 at file build/test/data/dfs/data/data8/current/blk_3283441132058347550
2013-10-31 16:22:39,202 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000006_0 0.0% setup
2013-10-31 16:22:39,204 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000006_0 is done.
2013-10-31 16:22:39,205 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000006_0 was -1
2013-10-31 16:22:39,205 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:39,459 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_-1078247713 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:39,469 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2525 with signal TERM. Exit code 0
2013-10-31 16:22:39,470 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_868079514 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:39,480 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2523 with signal TERM. Exit code 0
2013-10-31 16:22:39,694 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:39,694 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:39,694 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:39,694 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_868079514 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:39,831 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:39,831 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:39,832 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:39,832 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_-1078247713 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:39,848 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 16:22:39,855 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,860 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,866 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,869 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031160444934_0039_m_814554802 since job job_20131031160444934_0039 is dead
2013-10-31 16:22:39,873 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,878 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,879 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2417 with signal TERM. Exit code 0
2013-10-31 16:22:39,884 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_09442_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 16:22:39,884 INFO metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 16:22:40,032 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 16:22:40,032 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 16:22:40,032 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 16:22:40,032 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031160444934_0039_m_814554802 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 16:22:40,132 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000006_0' has completed task_20131031160444934_0040_m_000006 successfully.
2013-10-31 16:22:40,137 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000000_0' to tip task_20131031160444934_0040_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:40,138 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000000
2013-10-31 16:22:40,139 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000001_0' to tip task_20131031160444934_0040_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:43831'
2013-10-31 16:22:40,139 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000001
2013-10-31 16:22:40,141 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000002_0' to tip task_20131031160444934_0040_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:40,142 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000000_0 task's state:UNASSIGNED
2013-10-31 16:22:40,142 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000002
2013-10-31 16:22:40,143 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000001_0 task's state:UNASSIGNED
2013-10-31 16:22:40,144 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000003_0' to tip task_20131031160444934_0040_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:34092'
2013-10-31 16:22:40,144 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000000_0 which needs 1 slots
2013-10-31 16:22:40,145 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000000_0 which needs 1 slots
2013-10-31 16:22:40,145 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000003
2013-10-31 16:22:40,145 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000001_0 which needs 1 slots
2013-10-31 16:22:40,146 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0040_m_000001_0 which needs 1 slots
2013-10-31 16:22:40,149 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000002_0 task's state:UNASSIGNED
2013-10-31 16:22:40,152 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000003_0 task's state:UNASSIGNED
2013-10-31 16:22:40,152 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000002_0 which needs 1 slots
2013-10-31 16:22:40,152 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000002_0 which needs 1 slots
2013-10-31 16:22:40,153 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000003_0 which needs 1 slots
2013-10-31 16:22:40,153 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031160444934_0040_m_000003_0 which needs 1 slots
2013-10-31 16:22:40,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken dst=null perm=null
2013-10-31 16:22:40,161 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37235, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3316025396248904415_1470, duration: 303082
2013-10-31 16:22:40,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml dst=null perm=null
2013-10-31 16:22:40,171 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57273, bytes: 28491, op: HDFS_READ, cliID: DFSClient_-1517381369, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 160007
2013-10-31 16:22:40,179 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_106789973
2013-10-31 16:22:40,180 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_106789973 spawned.
2013-10-31 16:22:40,180 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031160444934_0040/attempt_20131031160444934_0040_m_000000_0. Attempting to reuse: jvm_20131031160444934_0040_m_29028229
2013-10-31 16:22:40,181 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000001_0/taskjvm.sh
2013-10-31 16:22:40,235 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:40,254 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_29028229 given task: attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:40,263 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031160444934_0040_m_000004_0' to tip task_20131031160444934_0040_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:40,264 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031160444934_0040_m_000004
2013-10-31 16:22:40,265 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000004_0 task's state:UNASSIGNED
2013-10-31 16:22:40,266 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000004_0 which needs 1 slots
2013-10-31 16:22:40,266 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000004_0 which needs 1 slots
2013-10-31 16:22:40,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040/jobToken dst=null perm=null
2013-10-31 16:22:40,318 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37238, bytes: 120, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-3316025396248904415_1470, duration: 156240
2013-10-31 16:22:40,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.xml dst=null perm=null
2013-10-31 16:22:40,327 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57276, bytes: 28491, op: HDFS_READ, cliID: DFSClient_-1105132378, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1832285968670934940_1467, duration: 162295
2013-10-31 16:22:40,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar dst=null perm=null
2013-10-31 16:22:40,331 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37241, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1517381369, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_-7119918970507031873_1464, duration: 597005
2013-10-31 16:22:40,341 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 16:22:40,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.jar dst=null perm=null
2013-10-31 16:22:40,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57278, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1105132378, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7119918970507031873_1464, duration: 636646
2013-10-31 16:22:40,386 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_1059952678
2013-10-31 16:22:40,387 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_1059952678 spawned.
2013-10-31 16:22:40,387 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_1963016599
2013-10-31 16:22:40,387 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_1963016599 spawned.
2013-10-31 16:22:40,388 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000003_0/taskjvm.sh
2013-10-31 16:22:40,389 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000002_0/taskjvm.sh
2013-10-31 16:22:40,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=null
2013-10-31 16:22:40,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37174, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4065104606401556411_1465, duration: 166524
2013-10-31 16:22:40,410 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_-1954864103
2013-10-31 16:22:40,411 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_-1954864103 spawned.
2013-10-31 16:22:40,412 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000004_0/taskjvm.sh
2013-10-31 16:22:41,140 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_106789973 given task: attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:41,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:22:41,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:41,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=null
2013-10-31 16:22:41,795 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37246, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_4065104606401556411_1465, duration: 170475
2013-10-31 16:22:41,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:41,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:22:41,856 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37178, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 128646
2013-10-31 16:22:41,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:41,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:42,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:42,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:42,089 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37180, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 126080
2013-10-31 16:22:42,092 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 109304
2013-10-31 16:22:42,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:42,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:42,098 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37182, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 104998
2013-10-31 16:22:42,099 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000. blk_1029130384283372836_1472
2013-10-31 16:22:42,107 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001. blk_3132855957661818780_1472
2013-10-31 16:22:42,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1029130384283372836_1472 src: /127.0.0.1:37183 dest: /127.0.0.1:50942
2013-10-31 16:22:42,123 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1029130384283372836_1472 src: /127.0.0.1:57290 dest: /127.0.0.1:41648
2013-10-31 16:22:42,124 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1029130384283372836_1472 src: /127.0.0.1:50288 dest: /127.0.0.1:47311
2013-10-31 16:22:42,127 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50288, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1029130384283372836_1472, duration: 2357055
2013-10-31 16:22:42,128 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1029130384283372836_1472 terminating
2013-10-31 16:22:42,128 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57290, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1029130384283372836_1472, duration: 2490784
2013-10-31 16:22:42,128 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1029130384283372836_1472 terminating
2013-10-31 16:22:42,128 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37183, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000000_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1029130384283372836_1472, duration: 3274433
2013-10-31 16:22:42,129 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1029130384283372836_1472 terminating
2013-10-31 16:22:42,129 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1029130384283372836_1472 size 8
2013-10-31 16:22:42,130 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000 from client DFSClient_attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:42,131 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:42,131 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1029130384283372836_1472 size 8
2013-10-31 16:22:42,131 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3132855957661818780_1472 src: /127.0.0.1:37253 dest: /127.0.0.1:38271
2013-10-31 16:22:42,131 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1029130384283372836_1472 size 8
2013-10-31 16:22:42,132 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3132855957661818780_1472 src: /127.0.0.1:37187 dest: /127.0.0.1:50942
2013-10-31 16:22:42,132 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3132855957661818780_1472 src: /127.0.0.1:50290 dest: /127.0.0.1:47311
2013-10-31 16:22:42,134 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50290, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_3132855957661818780_1472, duration: 1076873
2013-10-31 16:22:42,135 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3132855957661818780_1472 terminating
2013-10-31 16:22:42,135 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37187, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_3132855957661818780_1472, duration: 1479015
2013-10-31 16:22:42,135 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3132855957661818780_1472 terminating
2013-10-31 16:22:42,135 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_3132855957661818780_1472 size 8
2013-10-31 16:22:42,135 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37253, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000001_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 1904426
2013-10-31 16:22:42,136 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3132855957661818780_1472 terminating
2013-10-31 16:22:42,136 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001 from client DFSClient_attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:42,136 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:42,138 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_3132855957661818780_1472 size 8
2013-10-31 16:22:42,139 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_3132855957661818780_1472 size 8
2013-10-31 16:22:42,171 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:42,171 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000000_0 0.0%
2013-10-31 16:22:42,184 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:42,184 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000001_0 0.0%
2013-10-31 16:22:42,236 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_1059952678 given task: attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:42,476 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_1963016599 given task: attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:42,482 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_-1954864103 given task: attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:42,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=null
2013-10-31 16:22:42,737 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57297, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 1024, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_4065104606401556411_1465, duration: 157866
2013-10-31 16:22:42,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:22:42,776 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37262, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_8236244615419800290_1017, duration: 126153
2013-10-31 16:22:42,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:42,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:42,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=null
2013-10-31 16:22:42,969 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50298, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 512, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_4065104606401556411_1465, duration: 162014
2013-10-31 16:22:42,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040/job.split dst=null perm=null
2013-10-31 16:22:42,997 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37197, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 1024, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_4065104606401556411_1465, duration: 505334
2013-10-31 16:22:43,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:22:43,010 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37198, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 113277
2013-10-31 16:22:43,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:43,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:43,018 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57304, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-5411765967275090315_1003, duration: 120242
2013-10-31 16:22:43,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,027 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003. blk_-7009694866102085401_1474
2013-10-31 16:22:43,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 16:22:43,036 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37201, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_8236244615419800290_1017, duration: 114981
2013-10-31 16:22:43,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,050 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7009694866102085401_1474 src: /127.0.0.1:57305 dest: /127.0.0.1:41648
2013-10-31 16:22:43,051 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7009694866102085401_1474 src: /127.0.0.1:37202 dest: /127.0.0.1:50942
2013-10-31 16:22:43,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7009694866102085401_1474 src: /127.0.0.1:50305 dest: /127.0.0.1:47311
2013-10-31 16:22:43,054 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50305, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7009694866102085401_1474, duration: 1341820
2013-10-31 16:22:43,054 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7009694866102085401_1474 terminating
2013-10-31 16:22:43,055 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37202, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7009694866102085401_1474, duration: 1502943
2013-10-31 16:22:43,055 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7009694866102085401_1474 terminating
2013-10-31 16:22:43,055 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57305, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000003_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7009694866102085401_1474, duration: 1872932
2013-10-31 16:22:43,055 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7009694866102085401_1474 terminating
2013-10-31 16:22:43,055 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_-7009694866102085401_1474 size 8
2013-10-31 16:22:43,056 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_-7009694866102085401_1474 size 8
2013-10-31 16:22:43,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,056 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003 from client DFSClient_attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:43,056 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:43,059 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_-7009694866102085401_1474 size 8
2013-10-31 16:22:43,102 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:43,103 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000003_0 0.0%
2013-10-31 16:22:43,143 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000000_0
2013-10-31 16:22:43,144 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000001_0
2013-10-31 16:22:43,150 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000003_0
2013-10-31 16:22:43,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0 dst=null perm=null
2013-10-31 16:22:43,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0 dst=null perm=null
2013-10-31 16:22:43,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:43,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000000_0 dst=null perm=null
2013-10-31 16:22:43,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:43,363 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000000_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:0+4
2013-10-31 16:22:43,364 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000000_0 is done.
2013-10-31 16:22:43,365 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000000_0 was -1
2013-10-31 16:22:43,365 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:43,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:43,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:43,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:43,646 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50306, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-5411765967275090315_1003, duration: 270269
2013-10-31 16:22:43,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 16:22:43,650 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37205, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-5411765967275090315_1003, duration: 205299
2013-10-31 16:22:43,657 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002. blk_5205276690075938518_1475
2013-10-31 16:22:43,659 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004. blk_5513293134073518807_1475
2013-10-31 16:22:43,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5205276690075938518_1475 src: /127.0.0.1:57311 dest: /127.0.0.1:41648
2013-10-31 16:22:43,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5205276690075938518_1475 src: /127.0.0.1:37277 dest: /127.0.0.1:38271
2013-10-31 16:22:43,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5205276690075938518_1475 src: /127.0.0.1:37209 dest: /127.0.0.1:50942
2013-10-31 16:22:43,682 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5513293134073518807_1475 src: /127.0.0.1:50309 dest: /127.0.0.1:47311
2013-10-31 16:22:43,683 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5513293134073518807_1475 src: /127.0.0.1:37279 dest: /127.0.0.1:38271
2013-10-31 16:22:43,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37209, dest: /127.0.0.1:50942, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5205276690075938518_1475, duration: 946721
2013-10-31 16:22:43,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5205276690075938518_1475 terminating
2013-10-31 16:22:43,684 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5513293134073518807_1475 src: /127.0.0.1:57316 dest: /127.0.0.1:41648
2013-10-31 16:22:43,684 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37277, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5205276690075938518_1475, duration: 1322464
2013-10-31 16:22:43,684 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5205276690075938518_1475 size 8
2013-10-31 16:22:43,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5205276690075938518_1475 terminating
2013-10-31 16:22:43,684 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57311, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000002_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5205276690075938518_1475, duration: 1985256
2013-10-31 16:22:43,685 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5205276690075938518_1475 size 8
2013-10-31 16:22:43,685 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5205276690075938518_1475 terminating
2013-10-31 16:22:43,686 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002 from client DFSClient_attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:43,686 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:43,686 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_5205276690075938518_1475 size 8
2013-10-31 16:22:43,686 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57316, dest: /127.0.0.1:41648, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5513293134073518807_1475, duration: 34554
2013-10-31 16:22:43,686 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5513293134073518807_1475 terminating
2013-10-31 16:22:43,687 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37279, dest: /127.0.0.1:38271, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5513293134073518807_1475, duration: 484156
2013-10-31 16:22:43,687 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5513293134073518807_1475 terminating
2013-10-31 16:22:43,687 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50309, dest: /127.0.0.1:47311, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031160444934_0040_m_000004_0, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5513293134073518807_1475, duration: 855719
2013-10-31 16:22:43,687 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5513293134073518807_1475 terminating
2013-10-31 16:22:43,690 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_5513293134073518807_1475 size 8
2013-10-31 16:22:43,691 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:38271 is added to blk_5513293134073518807_1475 size 8
2013-10-31 16:22:43,691 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_5513293134073518807_1475 size 8
2013-10-31 16:22:43,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000001_0 dst=null perm=null
2013-10-31 16:22:43,897 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:43,897 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000002_0 0.0%
2013-10-31 16:22:44,089 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004 from client DFSClient_attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:44,090 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:44,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0 dst=null perm=null
2013-10-31 16:22:44,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:44,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:44,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000003_0 dst=null perm=null
2013-10-31 16:22:44,144 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031160444934_0040_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 16:22:44,144 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000004_0 0.0%
2013-10-31 16:22:44,722 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000001_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:4+4
2013-10-31 16:22:44,724 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000001_0 is done.
2013-10-31 16:22:44,724 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000001_0 was -1
2013-10-31 16:22:44,725 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:45,144 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031160444934_0040_m_000006_0
2013-10-31 16:22:45,144 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031160444934_0040_m_000006_0
2013-10-31 16:22:45,145 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031160444934_0040_m_000006_0 not found in cache
2013-10-31 16:22:45,665 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000003_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:12+4
2013-10-31 16:22:45,667 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000003_0 is done.
2013-10-31 16:22:45,667 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000003_0 was -1
2013-10-31 16:22:45,667 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 16:22:46,147 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000000_0' has completed task_20131031160444934_0040_m_000000 successfully.
2013-10-31 16:22:46,148 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000001_0' has completed task_20131031160444934_0040_m_000001 successfully.
2013-10-31 16:22:46,154 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000003_0' has completed task_20131031160444934_0040_m_000003 successfully.
2013-10-31 16:22:46,156 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000002_0
2013-10-31 16:22:46,270 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031160444934_0040_m_000004_0
2013-10-31 16:22:46,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0 dst=null perm=null
2013-10-31 16:22:46,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:46,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:46,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000002_0 dst=null perm=null
2013-10-31 16:22:47,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0 dst=null perm=null
2013-10-31 16:22:47,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 16:22:47,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:47,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary/_attempt_20131031160444934_0040_m_000004_0 dst=null perm=null
2013-10-31 16:22:48,952 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:22:48,954 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000002_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:8+4
2013-10-31 16:22:48,955 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000002_0 is done.
2013-10-31 16:22:48,955 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000002_0 was -1
2013-10-31 16:22:48,955 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:48,960 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:22:48,962 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000004_0 1.0% hdfs://localhost:43856/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/classes/test/data/lower.txt:16+3
2013-10-31 16:22:48,963 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000004_0 is done.
2013-10-31 16:22:48,963 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000004_0 was -1
2013-10-31 16:22:48,963 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:49,160 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000002_0' has completed task_20131031160444934_0040_m_000002 successfully.
2013-10-31 16:22:49,274 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000004_0' has completed task_20131031160444934_0040_m_000004 successfully.
2013-10-31 16:22:49,277 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031160444934_0040_m_000005_0' to tip task_20131031160444934_0040_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:51957'
2013-10-31 16:22:49,279 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031160444934_0040_m_000005_0 task's state:UNASSIGNED
2013-10-31 16:22:49,280 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031160444934_0040_m_000005_0 which needs 1 slots
2013-10-31 16:22:49,280 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031160444934_0040_m_000005_0 which needs 1 slots
2013-10-31 16:22:50,082 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031160444934_0040_m_181950006
2013-10-31 16:22:50,084 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031160444934_0040_m_181950006 spawned.
2013-10-31 16:22:50,086 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031160444934_0040/attempt_20131031160444934_0040_m_000005_0/taskjvm.sh
2013-10-31 16:22:51,279 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031160444934_0040_m_181950006 given task: attempt_20131031160444934_0040_m_000005_0
2013-10-31 16:22:51,798 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000005_0 0.0%
2013-10-31 16:22:51,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary dst=null perm=null
2013-10-31 16:22:51,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 16:22:51,831 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_SUCCESS from client DFSClient_attempt_20131031160444934_0040_m_000005_0
2013-10-31 16:22:51,832 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_SUCCESS is closed by DFSClient_attempt_20131031160444934_0040_m_000005_0
2013-10-31 16:22:51,839 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,839 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,840 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,840 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7119918970507031873 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:51,840 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:51,840 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,840 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,840 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4065104606401556411 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,841 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4703071415899710414 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,841 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4703071415899710414 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,841 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4703071415899710414 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,841 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1832285968670934940 is added to invalidSet of 127.0.0.1:41648
2013-10-31 16:22:51,841 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1832285968670934940 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:51,841 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1832285968670934940 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:51,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031160444934_0040 dst=null perm=null
2013-10-31 16:22:54,399 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:38271 to delete blk_1832285968670934940_1467 blk_4703071415899710414_1466 blk_-7119918970507031873_1464 blk_4065104606401556411_1465
2013-10-31 16:22:54,399 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:50942 to delete blk_-7119918970507031873_1464 blk_4065104606401556411_1465
2013-10-31 16:22:54,707 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031160444934_0040_m_000005_0 0.0% cleanup
2013-10-31 16:22:54,709 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031160444934_0040_m_000005_0 is done.
2013-10-31 16:22:54,709 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031160444934_0040_m_000005_0 was -1
2013-10-31 16:22:54,710 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 16:22:55,286 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031160444934_0040_m_000005_0' has completed task_20131031160444934_0040_m_000005 successfully.
2013-10-31 16:22:55,287 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031160444934_0040 has completed successfully.
2013-10-31 16:22:55,288 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031160444934_0040,submitTime=1383236552996,launchTime=1383236553115,firstMapTaskLaunchTime=1383236560137,firstJobSetupTaskLaunchTime=1383236554117,firstJobCleanupTaskLaunchTime=1383236569277,finishTime=1383236575287,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E32F3D93043E4CEB922DF05C02E89E52/DE1DC7DC113545DB8DAF51CAB5936FB2] lower*upper/(1/1) ...dpipesplatform/difffields
2013-10-31 16:22:55,293 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB. blk_1424377202590509271_1476
2013-10-31 16:22:55,295 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424377202590509271_1476 src: /127.0.0.1:50318 dest: /127.0.0.1:47311
2013-10-31 16:22:55,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424377202590509271_1476 src: /127.0.0.1:57322 dest: /127.0.0.1:41648
2013-10-31 16:22:55,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1424377202590509271_1476 src: /127.0.0.1:37218 dest: /127.0.0.1:50942
2013-10-31 16:22:55,311 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:37218, dest: /127.0.0.1:50942, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1424377202590509271_1476, duration: 5626263
2013-10-31 16:22:55,312 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1424377202590509271_1476 terminating
2013-10-31 16:22:55,312 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:57322, dest: /127.0.0.1:41648, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1424377202590509271_1476, duration: 6788313
2013-10-31 16:22:55,312 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1424377202590509271_1476 terminating
2013-10-31 16:22:55,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:50942 is added to blk_1424377202590509271_1476 size 26339
2013-10-31 16:22:55,317 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:41648 is added to blk_1424377202590509271_1476 size 26339
2013-10-31 16:22:55,317 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50318, dest: /127.0.0.1:47311, bytes: 26339, op: HDFS_WRITE, cliID: DFSClient_1064441706, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_1424377202590509271_1476, duration: 8667296
2013-10-31 16:22:55,317 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1424377202590509271_1476 terminating
2013-10-31 16:22:55,321 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB from client DFSClient_1064441706
2013-10-31 16:22:55,322 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_logs/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB is closed by DFSClient_1064441706
2013-10-31 16:22:55,322 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:47311 is added to blk_1424377202590509271_1476 size 26339
2013-10-31 16:22:55,338 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0040_1383236552996_hadoop_%5BE32F3D93043E4CEB922DF05C02E89E52%2FDE1DC7DC113545DB to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:55,341 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0040_m_000004_0'
2013-10-31 16:22:55,341 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031160444934_0040_m_000005_0'
2013-10-31 16:22:55,344 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3316025396248904415 is added to invalidSet of 127.0.0.1:38271
2013-10-31 16:22:55,344 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3316025396248904415 is added to invalidSet of 127.0.0.1:50942
2013-10-31 16:22:55,345 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3316025396248904415 is added to invalidSet of 127.0.0.1:47311
2013-10-31 16:22:55,347 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/job_20131031160444934_0040_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/log/history/done/version-1/localhost_1383235485004_/2013/10/31/000000
2013-10-31 16:22:55,351 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/_temporary
2013-10-31 16:22:55,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/tmp/mapred/system/job_20131031160444934_0040 dst=null perm=null
2013-10-31 16:22:55,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=null
2013-10-31 16:22:55,408 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:55,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000 dst=null perm=null
2013-10-31 16:22:55,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001 dst=null perm=null
2013-10-31 16:22:55,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002 dst=null perm=null
2013-10-31 16:22:55,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003 dst=null perm=null
2013-10-31 16:22:55,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004 dst=null perm=null
2013-10-31 16:22:55,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000 dst=null perm=null
2013-10-31 16:22:55,419 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37220, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1029130384283372836_1472, duration: 314074
2013-10-31 16:22:55,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001 dst=null perm=null
2013-10-31 16:22:55,422 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37290, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 256728
2013-10-31 16:22:55,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002 dst=null perm=null
2013-10-31 16:22:55,425 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37222, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5205276690075938518_1475, duration: 256518
2013-10-31 16:22:55,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003 dst=null perm=null
2013-10-31 16:22:55,428 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50325, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_-7009694866102085401_1474, duration: 254613
2013-10-31 16:22:55,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004 dst=null perm=null
2013-10-31 16:22:55,431 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:47311, dest: /127.0.0.1:50326, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1772526979-10.5.128.102-47311-1383235482154, blockid: blk_5513293134073518807_1475, duration: 260127
2013-10-31 16:22:55,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=null
2013-10-31 16:22:55,449 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 16:22:55,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000 dst=null perm=null
2013-10-31 16:22:55,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001 dst=null perm=null
2013-10-31 16:22:55,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002 dst=null perm=null
2013-10-31 16:22:55,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003 dst=null perm=null
2013-10-31 16:22:55,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004 dst=null perm=null
2013-10-31 16:22:55,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000 dst=null perm=null
2013-10-31 16:22:55,456 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37225, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_1029130384283372836_1472, duration: 152494
2013-10-31 16:22:55,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001 dst=null perm=null
2013-10-31 16:22:55,458 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37295, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 110093
2013-10-31 16:22:55,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002 dst=null perm=null
2013-10-31 16:22:55,460 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37296, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_5205276690075938518_1475, duration: 272940
2013-10-31 16:22:55,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003 dst=null perm=null
2013-10-31 16:22:55,462 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57333, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_-7009694866102085401_1474, duration: 265479
2013-10-31 16:22:55,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004 dst=null perm=null
2013-10-31 16:22:55,464 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57334, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5513293134073518807_1475, duration: 263080
2013-10-31 16:22:55,464 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output//hadoop/joinfieldedpipesplatform/difffields
2013-10-31 16:22:55,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields dst=null perm=null
2013-10-31 16:22:55,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00000 dst=null perm=null
2013-10-31 16:22:55,470 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57335, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_1029130384283372836_1472, duration: 268786
2013-10-31 16:22:55,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00001 dst=null perm=null
2013-10-31 16:22:55,474 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:38271, dest: /127.0.0.1:37300, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-799621837-10.5.128.102-38271-1383235481550, blockid: blk_3132855957661818780_1472, duration: 235436
2013-10-31 16:22:55,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00002 dst=null perm=null
2013-10-31 16:22:55,478 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37232, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_5205276690075938518_1475, duration: 261219
2013-10-31 16:22:55,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00003 dst=null perm=null
2013-10-31 16:22:55,482 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:50942, dest: /127.0.0.1:37233, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1876337673-10.5.128.102-50942-1383235484753, blockid: blk_-7009694866102085401_1474, duration: 252029
2013-10-31 16:22:55,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.1/build/test/output/hadoop/joinfieldedpipesplatform/difffields/part-00004 dst=null perm=null
2013-10-31 16:22:55,486 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:41648, dest: /127.0.0.1:57339, bytes: 12, op: HDFS_READ, cliID: DFSClient_1457307213, offset: 0, srvID: DS-1634612289-10.5.128.102-41648-1383235482785, blockid: blk_5513293134073518807_1475, duration: 254309